Apache Hadoop Ecosystem

Apache Hadoop Ecosystem

  • Hadoop HDFS - 2007 - A distributed file system for reliably storing huge amounts of unstructured, semi-structured and structured data in the form of files. 
  • Hadoop MapReduce - 2007 - A distributed algorithm framework for the parallel processing of large datasets on HDFS filesystem. It runs on Hadoop cluster but also supports other database formats like Cassandra and HBase. 
  • Cassandra - 2008 - A key-value pair NoSQL database, with column family data representation and asynchronous masterless replication. 
  • HBase - 2008 - A key-value pair NoSQL database, with column family data representation, with master-slave replication. It uses HDFS as underlying storage. 
  • Zookeeper - 2008 - A distributed coordination service for distributed applications. It is based on Paxos algorithm variant called Zab. 
  • Pig - 2009 - Pig is a scripting interface over MapReduce for developers who prefer scripting interface over native Java MapReduce programming. 
  • Hive - 2009 - Hive is a SQL interface over MapReduce for developers and analysts who prefer SQL interface over native Java MapReduce programming. 
  • Mahout - 2009 - A library of machine learning algorithms, implemented on top of MapReduce, for finding meaningful patterns in HDFS datasets. 
  • Sqoop - 2010 - A tool to import data from RDBMS/DataWarehouse into HDFS/HBase and export back. 
  • YARN - 2011 - A system to schedule applications and services on an HDFS cluster and manage the cluster resources like memory and CPU. 
  • Flume - 2011 - A tool to collect, aggregate, reliably move and ingest large amounts of data into HDFS. 
  • Storm - 2011 - A system to process high-velocity streaming data with 'at least once' message semantics. 
  • Spark - 2012 - An in-memory data processing engine that can run a DAG of operations. It provides libraries for Machine Learning, SQL interface and near real-time Stream Processing. 
  • Kafka - 2012 - A distributed messaging system with partitioned topics for very high scalability. 
  • SolrCloud - 2012 - A distributed search engine with a REST-like interface for full-text search. It uses Lucene library for data indexing.

Comments

  1. for IT the25 March 2018 at 08:00

    great

    ReplyDelete
  2. ari metaforum5 June 2018 at 01:57

    nice

    ReplyDelete
  3. Kamal25 June 2018 at 01:11

    Much thanks to you for setting aside opportunity to composing your experience.This is extremely useful.
    Education | Article Submission sites | MBA Guide | Technology

    ReplyDelete
  4. Vicky Ram4 July 2018 at 00:08

    Wonderful post!!Thank you for sharing this info with us.
    Keep updating I would like to know more updates on this topic
    Very useful content, I would like to suggest this blog to my friends.

    Best Hadoop Training in Chennai
    Big Data Hadoop Training in Chennai

    ReplyDelete
  5. Malar Pretty10 July 2018 at 22:46

    This technical post helps me to improve my skills ,thanks for this wonder post I expect your upcoming blog, so keep sharing...
    Articles
    Technology updates

    ReplyDelete
  6. ajay ak14 July 2018 at 01:59


    Pretty blog, so many ideas in a single site, thanks for the informative article, keep updating more article.
    Digital marketing course in chennai

    ReplyDelete
  7. rajesh redddy20 July 2018 at 00:58

    Best tutorial on hadoop for freshers among lots of available. Super work
    Hadoop Training in Chennai

    ReplyDelete
  8. Vicky Ram20 July 2018 at 05:32

    Thanks for sharing your knowledge with us .This will absolutely going to help me in my future .

    Big Data Training Chennai

    Best hadoop training institute in chennai

    ReplyDelete
  9. ari metaforum24 July 2018 at 04:54

    Thanks for sharing
    Hadoop Training In Chennai

    ReplyDelete
  10. STAAR WD4 August 2018 at 22:38

    It's event-driven, and builders not should depend on the ops to check their code. They'll shortly run, check and deploy their code with out getting tangled within the conventional workflow.This is great blog. If you want to know more about this visit here Internet of Things.

    ReplyDelete
  11. pooja saravanan25 August 2018 at 02:56

    Your good knowledge and kindness in playing with all the pieces were very useful. I don’t know what I would have done if I had not encountered such a step like this.
    Online training in USA

    ReplyDelete
  12. sai25 August 2018 at 04:05

    Those guidelines additionally worked to become a good way to recognize that other people online have the identical fervor like mine to grasp great deal more around this condition.
    Click here:
    Online training in USA

    ReplyDelete
  13. pooja saravanan25 August 2018 at 05:19

    Thank you a lot for providing individuals with a very spectacular possibility to read critical reviews from this site.

    Online training in USA

    ReplyDelete
  14. Unknown25 August 2018 at 07:00

    I feel really happy to have seen your webpage and look forward to so many more entertaining times reading here. Thanks once more for all the details.Online training in USA

    ReplyDelete
  15. keerthana16 September 2018 at 22:12

    This information is impressive; I am inspired with your post . Keep posting like this, THis is very useful .. Thank you so much.. Waiting for more blogs like this.

    Best Big Data Training in Chennai

    Hadoop Big Data Training in Chennai

    ReplyDelete
  16. Aruna Ram24 September 2018 at 04:23

    This is an awesome post. Really very informative and creative contents. These concept is a good way to enhance the knowledge. Thank you for this brief explanation and very nice information.
    Big Data Certification in Chennai | Best Hadoop Training in Chennai | Best hadoop training institute in chennai | Hadoop Course in Chennai | Best Big Data Training in Chennai

    ReplyDelete
  17. aravinth periyaswami28 September 2018 at 06:58

    It's interesting that many of the bloggers to helped clarify a few things for me as well as giving.Most of ideas can be nice content.The people to give them a good shake to get your point and across the command.
    aws training in chennai

    hadoop training in chennai

    ReplyDelete
  18. Allen Christina3 October 2018 at 04:05

    innovative and creative informations about hadoop.keep add this kind of new information which is really worth for us.Big data hadoop training
    Hadoop big data training in chennai
    Big data training institute in chennai
    Best hadoop training in chennai

    ReplyDelete
  19. Vicky Ram4 October 2018 at 05:35

    Wonderful post!! Thanks for sharing this blog .

    Simple Truth

    Article submission sites

    ReplyDelete
  20. pavithra dass22 October 2018 at 01:41

    Its a wonderful post and very helpful, thanks for all this information. You are including better information regarding this topic in an effective way. T hank you so much.
    Python Training in Chennai
    Digital Marketing Course in Chennai
    Python Training classes in Chennai
    Python Training Chennai
    Digital Marketing Training Institutes in Chennai
    Digital Marketing Chennai

    ReplyDelete
  21. mathimathi2 November 2018 at 23:57

    Wow! What an article.. and beautiful photos! And just at the right time!
    Python Training in Chennai |
    Python course in Chennai |
    Oracle dba training in chennai

    ReplyDelete
  22. mathimathi2 November 2018 at 23:58

    Comprehensive article and breathtaking images...
    SQL Training in Chennai |
    SQL course in Chennai |
    SQL Classes in chennai

    ReplyDelete
  23. thulasiram9 November 2018 at 00:56

    It’s a classic great for me to go to this blog site, it offers helpful suggestions
    JAVA Training in Chennai |
    JAVA Course in Chennai |
    Best JAVA Training in Chennai

    ReplyDelete
  24. thulasiram9 November 2018 at 00:58

    Hi to all, the blog has really the dreadful information I really enjoyed a lot.
    Big Data Training in Chennai |
    Big Data Training |
    Big Data Course in Chennai



    ReplyDelete
  25. swetha singh12 November 2018 at 00:47

    Thanks for providing wonderful information with us. Thank you so much.
    Aviation Academy in Chennai
    Aviation Courses in Chennai
    fly air aviation academy chennai
    aviation training in chennai

    ReplyDelete
  26. Vicky Ram12 November 2018 at 04:45

    Thanks for your sharing such a useful information. this was really helpful to me

    Education
    Technology

    ReplyDelete
  27. Mageshkumar14 November 2018 at 01:13

    Great information about Medical Billing Services and EMR Software. So many people have a confusion related to the field of billing and coding. This is a kind of article that can help those people
    Hadoop Training Chennai |
    Hadoop Training in Chennai |
    Big Data Training in Chennai

    ReplyDelete
  28. Mageshkumar14 November 2018 at 01:13

    So nice to read.Its very useful for me to get more valuable info about Medical Billing Coding Service.Thanks for it.Keep going.
    Cloud computing Training |
    Cloud computing Training in Chennai |
    Cloud computing courses in Chennai

    ReplyDelete
  29. ajay prakash28 November 2018 at 20:22

    I have gone through your blog, it was very much useful for me and because of your blog, and also I gained many unknown information, the way you have clearly explained is really fantastic. Kindly post more like this, Thank You.
    Airport management courses in chennai
    Airport Management Training in Chennai
    Airline Courses in Chennai
    airport courses in chennai

    ReplyDelete
  30. Suba11 December 2018 at 02:30

    Really nice and interesting post. I was looking for this kind of information and enjoyed reading this one.

    Best selenium training in chennai
    Best Selenium Training Institute in Chennai
    Big Data Training in Chennai
    iOS Training in Chennai
    French Classes in Chennai
    french language course in chennai
    french course in chennai

    ReplyDelete
  31. Madhu Bala23 December 2018 at 05:21



    Impressive content, keep doing more.
    JAVA Training in Chennai
    Hadoop Training in Chennai

    ReplyDelete
  32. alex17 January 2019 at 04:05

    Fascinating casino life online. best online gambling sites Play online casino at BGAOC.

    ReplyDelete
  33. pavithra dass29 January 2019 at 02:47

    Fruitful information. I like your post and it is very useful for my research. Keep sharing!!
    Selenium Training in Chennai
    Selenium Course in Chennai
    Java Training in Chennai
    Hadoop Training in Chennai
    German Classes in Chennai
    Selenium Training in AnnaNagar
    Selenium Training in Tambaram

    ReplyDelete
  34. tamizh31 January 2019 at 21:48

    I appreciate that you produced this wonderful article to help us get more knowledge about this topic.
    I know, it is not an easy task to write such a big article in one day, I've tried that and I've failed. But, here you are, trying the big task and finishing it off and getting good comments and ratings. That is one hell of a job done!



    Selenium training in bangalore
    Selenium training in Chennai
    Selenium training in Bangalore
    Selenium training in Pune
    Selenium Online training

    ReplyDelete
  35. Aruna Ram11 March 2019 at 22:55

    I appreciate for your great work, This post is a very simple and in-depth concept. Very useful for me and keep it up!
    Linux Training in Chennai
    Linux Course in Chennai
    Tableau Training in Chennai
    Spark Training in Chennai
    Power BI Training in Chennai
    Oracle Training in Chennai
    Oracle DBA Training in Chennai
    Linux Training in OMR
    Linux Training in Velachery

    ReplyDelete
  36. sheela rajesh13 March 2019 at 00:10

    The way of you expressing your ideas is really good.you gave more useful ideas for us and please update more ideas for the learners.
    Python Training in Chennai
    IOS Training in Chennai
    Hadoop training in chennai
    Big data training in chennai
    big data training in chennai anna nagar

    ReplyDelete
  37. Anbarasan1415 March 2019 at 02:09

    Thanks to the author of this blog for writing it in an easy to understand way. Was really a well-written blog.

    Computer Education Franchise
    Education Franchise India
    Computer Center Franchise
    Education Franchise Opportunities in India
    Education Franchise India
    Spoken English Franchise
    Franchise For Spoken English Classes
    Top Education Franchise in India
    Best Education Franchise in India

    ReplyDelete

Post a Comment

Popular posts from this blog

Big Data After The Internet

Image
Till 1995 most of the people did not know about the internet. It was hard to use, till the Netscape browser arrived and its famous IPO happened. The arrival of Netscape meant anyone could create material and anyone with a connection could view it.
Internet's popularity resulted in mushrooming of websites like AOL, MSN, Yahoo, CNN, Napster and so many more. They provided free information sharing services like emails, chats, photograph sharing, video sharing, blogging, news, weather, music, games etc. These sites were generating, collecting and sharing an enormous amount of data, for the people all over the globe. There were, of course, new generation e-commerce companies like Amazon and eBay that also contributed to the overall information available, but sharing of information was not at the core of their strategy.  
Why this phenomenon of information sharing noteworthy? There are two good reasons: 
The data on the Internet was freely available to everyone on the Internet. It was no l…
Read more