Apache Hadoop Ecosystem
- Hadoop HDFS - 2007 - A distributed file system for reliably storing huge amounts of unstructured, semi-structured and structured data in the form of files.
- Hadoop MapReduce - 2007 - A distributed algorithm framework for the parallel processing of large datasets on HDFS filesystem. It runs on Hadoop cluster but also supports other database formats like Cassandra and HBase.
- Cassandra - 2008 - A key-value pair NoSQL database, with column family data representation and asynchronous masterless replication.
- HBase - 2008 - A key-value pair NoSQL database, with column family data representation, with master-slave replication. It uses HDFS as underlying storage.
- Zookeeper - 2008 - A distributed coordination service for distributed applications. It is based on Paxos algorithm variant called Zab.
- Pig - 2009 - Pig is a scripting interface over MapReduce for developers who prefer scripting interface over native Java MapReduce programming.
- Hive - 2009 - Hive is a SQL interface over MapReduce for developers and analysts who prefer SQL interface over native Java MapReduce programming.
- Mahout - 2009 - A library of machine learning algorithms, implemented on top of MapReduce, for finding meaningful patterns in HDFS datasets.
- Sqoop - 2010 - A tool to import data from RDBMS/DataWarehouse into HDFS/HBase and export back.
- YARN - 2011 - A system to schedule applications and services on an HDFS cluster and manage the cluster resources like memory and CPU.
- Flume - 2011 - A tool to collect, aggregate, reliably move and ingest large amounts of data into HDFS.
- Storm - 2011 - A system to process high-velocity streaming data with 'at least once' message semantics.
- Spark - 2012 - An in-memory data processing engine that can run a DAG of operations. It provides libraries for Machine Learning, SQL interface and near real-time Stream Processing.
- Kafka - 2012 - A distributed messaging system with partitioned topics for very high scalability.
- SolrCloud - 2012 - A distributed search engine with a REST-like interface for full-text search. It uses Lucene library for data indexing.
great
ReplyDeletenice
ReplyDeleteGreat Article
DeleteIEEE Projects for CSE in Big Data
Java Training in Chennai
Final Year Project Centers in Chennai
Java Training in Chennai
This technical post helps me to improve my skills ,thanks for this wonder post I expect your upcoming blog, so keep sharing...
ReplyDeleteArticles
Technology updates
ReplyDeletePretty blog, so many ideas in a single site, thanks for the informative article, keep updating more article.
Digital marketing course in chennai
Best tutorial on hadoop for freshers among lots of available. Super work
ReplyDeleteHadoop Training in Chennai
Thanks for sharing your knowledge with us .This will absolutely going to help me in my future .
ReplyDeleteBig Data Training Chennai
Best hadoop training institute in chennai
Thanks for sharing
ReplyDeleteHadoop Training In Chennai
It's event-driven, and builders not should depend on the ops to check their code. They'll shortly run, check and deploy their code with out getting tangled within the conventional workflow.This is great blog. If you want to know more about this visit here Internet of Things.
ReplyDeleteYour good knowledge and kindness in playing with all the pieces were very useful. I don’t know what I would have done if I had not encountered such a step like this.
ReplyDeleteOnline training in USA
Those guidelines additionally worked to become a good way to recognize that other people online have the identical fervor like mine to grasp great deal more around this condition.
ReplyDeleteClick here:
Online training in USA
Thank you a lot for providing individuals with a very spectacular possibility to read critical reviews from this site.
ReplyDeleteOnline training in USA
I feel really happy to have seen your webpage and look forward to so many more entertaining times reading here. Thanks once more for all the details.Online training in USA
ReplyDeleteIt's interesting that many of the bloggers to helped clarify a few things for me as well as giving.Most of ideas can be nice content.The people to give them a good shake to get your point and across the command.
ReplyDeleteaws training in chennai
hadoop training in chennai
Wonderful post!! Thanks for sharing this blog .
ReplyDeleteSimple Truth
Article submission sites
Thanks for your sharing such a useful information. this was really helpful to me
ReplyDeleteEducation
Technology
ReplyDeleteImpressive content, keep doing more.
JAVA Training in Chennai
Hadoop Training in Chennai
Fascinating casino life online. best online gambling sites Play online casino at BGAOC.
ReplyDeletethe explanation of this topic you posted is very good. please upgrade the new technologies about this topic.
ReplyDeleteSelenium Training in Bangalore
Selenium Classes in Bangalore
Selenium Course in Bangalore
Data Science Courses in Bangalore
German Classes in Bangalore
AWS Course in Bangalore
Best Devops Training in Bangalore
Best Java Training Institutes in Bangalore
Big Data Analytics Training in Bangalore
I am feeling happy to read this. You gave nice info to me. Please update more.
ReplyDeleteEthical Hacking course in Chennai
Ethical Hacking Training in Chennai
Hacking course in Chennai
ccna course in Chennai
Salesforce Training in Chennai
AngularJS Training in Chennai
PHP Training in Chennai
Ethical Hacking course in Tambaram
Ethical Hacking course in Velachery
Ethical Hacking course in T Nagar
Nice article I was really impressed by seeing this blog, it was very interesting and it is very useful for me.
ReplyDeleteBlue Prism Training in Chennai
Blue Prism Training Chennai
AWS Training in Chennai
DevOps certification in Chennai
VMware Training in Chennai
Blue Prism Training in Anna Nagar
Blue Prism Training in Velachery
Blue Prism Training in Tambaram
Blue Prism Training in Adyar
I am glad that I have visited your blog, really amazing. Waiting for further updates.
ReplyDeleteBlue Prism Training in Chennai
DevOps Training in Chennai
MVC Training in Chennai
Innovative blog...!!! This is the best post and I got more ideas from your post. Keep continuous....
ReplyDeleteJMeter Training in Chennai
JMeter Training
Power BI Training in Chennai
Job Openings in Chennai
Linux Training in Chennai
Tableau Training in Chennai
Oracle Training in Chennai
Oracle DBA Training in Chennai
JMeter Training in Velachery
JMeter Training in Vadapalani
Excellent Blog. Thank you so much for sharing.
ReplyDeletehadoop interview questions
Hadoop interview questions for experienced
Hadoop interview questions for freshers
top 100 hadoop interview questions
frequently asked hadoop interview questions
hadoop interview questions and answers for freshers
hadoop interview questions and answers pdf
hadoop interview questions and answers
hadoop interview questions and answers for experienced
hadoop interview questions and answers for testers
hadoop interview questions and answers pdf download
hadoop interview questions pdf
Great blog thanks for sharing Looking for the best creative agency to fuel new brand ideas? Adhuntt Media is not just a digital marketing company in chennai. We specialize in revamping your brand identity to drive in best traffic that converts.
ReplyDeleteNice blog thanks for sharing Set up a aesthetic work environment that employees love to spend time in and relieve their stress. Your company needs the best corporate gardening service in Chennai and Karuna Nursery Gardens in happy to oblige you in the endeavour to make your infrastructure something worth flaunting about.
ReplyDeleteExcellent blog thanks for sharing Run your salon business successfully by tying up with the best beauty shop in Chennai - The Pixies Beauty Shop. With tons of prestigious brands to choose from, and amazing offers we’ll have you amazed.
ReplyDeleteAwesome blog thanks for sharing While choosing your perfect ride for driving, Accord Cars comes with and the best packages for you to pick from. Car rentals for self drive in Chennai are done the easier. Just pick out your plan from hourly, daily, weekly and even monthly plans available.
ReplyDeleteVery useful blog thanks for sharing With over a three decade of beauty expertise at our fingertips, we believed that everyone has the right to be beautiful. And so began the journey of our very own Pearl’s Beautician course in Chennai.
ReplyDeleteHi, thank you very much for new information, i learned something new. Very well written.It was so good to read and usefull to improve knowledge.Keep posting. If you are looking for any big data hadoop related information please visit our website.
ReplyDeletebig data hadoop training in bangalore.
I have been reading all your blogs regularly..I admit, this is one of the best blogs I have read till date. Great going.. Waiting for the next...
ReplyDeleteSpoken English Classes in Chennai
Spoken English in Chennai
Top 10 Spoken English Classes in Chennai
Best IELTS Coaching in Chennai
IELTS Coaching Centre in Chennai
English Classes in Mumbai
English Speaking Classes in Mumbai
Best IELTS Coaching in Mumbai
IELTS Coaching in Mumbai
Spoken English Class in Anna Nagar
Fabulous post admin, it was too good and helpful. Waiting for more updates.
ReplyDeleteTally course in Chennai
Tally Training in Chennai
Tally institute in Chennai
Thanks for the informative article. This is one of the best resources I have found in quite some time.
ReplyDeleteHadoop Admin Training in Chennai
Hadoop Administration Course in Chennai
TOEFL Coaching in Chennai
French Classes in Chennai
pearson vue test center in chennai
Informatica Training in Chennai
spanish language in chennai
content writing training in chennai
Hadoop Admin Training in Adyar
Hadoop Admin Training in Velachery
asdfgh
ReplyDeleteThanks for sharing valuable information.
ReplyDeleteDigital Marketing training Course in chennai
digital marketing training institute in chennai
digital marketing training in Chennai
digital marketing course in Chennai
digital marketing course training in omr
digital marketing certification in omr
digital marketing course training in velachery
digital marketing training center in chennai
digital marketing courses with placement in chennai
digital marketing certification in chennai
digital marketing institute in Chennai
digital marketing certification course in Chennai
digital marketing course training in Chennai
Digital Marketing course in Chennai with placement
digital marketing courses in chennai
Content Writing Company in Delhi
ReplyDeleteContent Writing Services in Delhi
Mobile App Development Company Delhi
PPC Company in Delhi
PPC Company in India
Awesome blog thankks for sharing 100% virgin Remy Hair Extension in USA, importing from India. Premium and original human hair without joints and bondings. Available in Wigs, Frontal, Wavy, Closure, Bundle, Curly, straight and customized color hairstyles Extensions.
ReplyDeleteVery useful blog thanks for sharing IndPac India the German technology Packaging and sealing machines in India is the leading manufacturer and exporter of Packing Machines in India.
ReplyDeleteThanks for sharing useful information. I learned something new from your bog. Its very interesting and informative. keep updating. If you are looking for any Data science related information, please visit our website Data Science training institute in bangalore
ReplyDelete