Apache Hadoop Ecosystem

Apache Hadoop Ecosystem

  • Hadoop HDFS - 2007 - A distributed file system for reliably storing huge amounts of unstructured, semi-structured and structured data in the form of files. 
  • Hadoop MapReduce - 2007 - A distributed algorithm framework for the parallel processing of large datasets on HDFS filesystem. It runs on Hadoop cluster but also supports other database formats like Cassandra and HBase. 
  • Cassandra - 2008 - A key-value pair NoSQL database, with column family data representation and asynchronous masterless replication. 
  • HBase - 2008 - A key-value pair NoSQL database, with column family data representation, with master-slave replication. It uses HDFS as underlying storage. 
  • Zookeeper - 2008 - A distributed coordination service for distributed applications. It is based on Paxos algorithm variant called Zab. 
  • Pig - 2009 - Pig is a scripting interface over MapReduce for developers who prefer scripting interface over native Java MapReduce programming. 
  • Hive - 2009 - Hive is a SQL interface over MapReduce for developers and analysts who prefer SQL interface over native Java MapReduce programming. 
  • Mahout - 2009 - A library of machine learning algorithms, implemented on top of MapReduce, for finding meaningful patterns in HDFS datasets. 
  • Sqoop - 2010 - A tool to import data from RDBMS/DataWarehouse into HDFS/HBase and export back. 
  • YARN - 2011 - A system to schedule applications and services on an HDFS cluster and manage the cluster resources like memory and CPU. 
  • Flume - 2011 - A tool to collect, aggregate, reliably move and ingest large amounts of data into HDFS. 
  • Storm - 2011 - A system to process high-velocity streaming data with 'at least once' message semantics. 
  • Spark - 2012 - An in-memory data processing engine that can run a DAG of operations. It provides libraries for Machine Learning, SQL interface and near real-time Stream Processing. 
  • Kafka - 2012 - A distributed messaging system with partitioned topics for very high scalability. 
  • SolrCloud - 2012 - A distributed search engine with a REST-like interface for full-text search. It uses Lucene library for data indexing.

Comments

  1. for ict 9925 March 2018 at 08:00

    great

    ReplyDelete
  2. Unknown5 June 2018 at 01:57

    nice

    ReplyDelete
  3. Malar Pretty10 July 2018 at 22:46

    This technical post helps me to improve my skills ,thanks for this wonder post I expect your upcoming blog, so keep sharing...
    Articles
    Technology updates

    ReplyDelete
  4. Naveen S14 July 2018 at 01:59


    Pretty blog, so many ideas in a single site, thanks for the informative article, keep updating more article.
    Digital marketing course in chennai

    ReplyDelete
  5. Anonymous20 July 2018 at 00:58

    Best tutorial on hadoop for freshers among lots of available. Super work
    Hadoop Training in Chennai

    ReplyDelete
  6. Vicky Ram20 July 2018 at 05:32

    Thanks for sharing your knowledge with us .This will absolutely going to help me in my future .

    Big Data Training Chennai

    Best hadoop training institute in chennai

    ReplyDelete
  7. Unknown24 July 2018 at 04:54

    Thanks for sharing
    Hadoop Training In Chennai

    ReplyDelete
  8. Staarwd4 August 2018 at 22:38

    It's event-driven, and builders not should depend on the ops to check their code. They'll shortly run, check and deploy their code with out getting tangled within the conventional workflow.This is great blog. If you want to know more about this visit here Internet of Things.

    ReplyDelete
  9. pooja25 August 2018 at 02:56

    Your good knowledge and kindness in playing with all the pieces were very useful. I don’t know what I would have done if I had not encountered such a step like this.
    Online training in USA

    ReplyDelete
  10. sai25 August 2018 at 04:05

    Those guidelines additionally worked to become a good way to recognize that other people online have the identical fervor like mine to grasp great deal more around this condition.
    Click here:
    Online training in USA

    ReplyDelete
  11. pooja25 August 2018 at 05:19

    Thank you a lot for providing individuals with a very spectacular possibility to read critical reviews from this site.

    Online training in USA

    ReplyDelete
  12. genga g25 August 2018 at 07:00

    I feel really happy to have seen your webpage and look forward to so many more entertaining times reading here. Thanks once more for all the details.Online training in USA

    ReplyDelete
  13. Unknown28 September 2018 at 06:58

    It's interesting that many of the bloggers to helped clarify a few things for me as well as giving.Most of ideas can be nice content.The people to give them a good shake to get your point and across the command.
    aws training in chennai

    hadoop training in chennai

    ReplyDelete
  14. Vicky Ram4 October 2018 at 05:35

    Wonderful post!! Thanks for sharing this blog .

    Simple Truth

    Article submission sites

    ReplyDelete
  15. Vicky Ram12 November 2018 at 04:45

    Thanks for your sharing such a useful information. this was really helpful to me

    Education
    Technology

    ReplyDelete
  16. Madhu Bala23 December 2018 at 05:21



    Impressive content, keep doing more.
    JAVA Training in Chennai
    Hadoop Training in Chennai

    ReplyDelete
  17. alex17 January 2019 at 04:05

    Fascinating casino life online. best online gambling sites Play online casino at BGAOC.

    ReplyDelete
  18. anushya24 June 2019 at 23:03

    the explanation of this topic you posted is very good. please upgrade the new technologies about this topic.
    Selenium Training in Bangalore
    Selenium Classes in Bangalore
    Selenium Course in Bangalore
    Data Science Courses in Bangalore
    German Classes in Bangalore
    AWS Course in Bangalore
    Best Devops Training in Bangalore
    Best Java Training Institutes in Bangalore
    Big Data Analytics Training in Bangalore

    ReplyDelete
  19. velraj25 June 2019 at 05:58

    I am feeling happy to read this. You gave nice info to me. Please update more.
    Ethical Hacking course in Chennai
    Ethical Hacking Training in Chennai
    Hacking course in Chennai
    ccna course in Chennai
    Salesforce Training in Chennai
    AngularJS Training in Chennai
    PHP Training in Chennai
    Ethical Hacking course in Tambaram
    Ethical Hacking course in Velachery
    Ethical Hacking course in T Nagar

    ReplyDelete
  20. sultana26 June 2019 at 05:35

    Nice article I was really impressed by seeing this blog, it was very interesting and it is very useful for me.
    Blue Prism Training in Chennai
    Blue Prism Training Chennai
    AWS Training in Chennai
    DevOps certification in Chennai
    VMware Training in Chennai
    Blue Prism Training in Anna Nagar
    Blue Prism Training in Velachery
    Blue Prism Training in Tambaram
    Blue Prism Training in Adyar

    ReplyDelete
  21. Balaji26 June 2019 at 23:38

    I am glad that I have visited your blog, really amazing. Waiting for further updates.

    Blue Prism Training in Chennai
    DevOps Training in Chennai
    MVC Training in Chennai

    ReplyDelete
  22. Aparna28 June 2019 at 03:52

    Innovative blog...!!! This is the best post and I got more ideas from your post. Keep continuous....
    JMeter Training in Chennai
    JMeter Training
    Power BI Training in Chennai
    Job Openings in Chennai
    Linux Training in Chennai
    Tableau Training in Chennai
    Oracle Training in Chennai
    Oracle DBA Training in Chennai
    JMeter Training in Velachery
    JMeter Training in Vadapalani

    ReplyDelete
  23. Venkatesh CS17 July 2019 at 00:46

    Excellent Blog. Thank you so much for sharing.
    hadoop interview questions
    Hadoop interview questions for experienced
    Hadoop interview questions for freshers
    top 100 hadoop interview questions
    frequently asked hadoop interview questions
    hadoop interview questions and answers for freshers
    hadoop interview questions and answers pdf
    hadoop interview questions and answers
    hadoop interview questions and answers for experienced
    hadoop interview questions and answers for testers
    hadoop interview questions and answers pdf download
    hadoop interview questions pdf

    ReplyDelete
  24. Adhuntt5 August 2019 at 23:36

    Great blog thanks for sharing Looking for the best creative agency to fuel new brand ideas? Adhuntt Media is not just a digital marketing company in chennai. We specialize in revamping your brand identity to drive in best traffic that converts.

    ReplyDelete
  25. Karuna6 August 2019 at 00:05

    Nice blog thanks for sharing Set up a aesthetic work environment that employees love to spend time in and relieve their stress. Your company needs the best corporate gardening service in Chennai and Karuna Nursery Gardens in happy to oblige you in the endeavour to make your infrastructure something worth flaunting about.

    ReplyDelete
  26. Pixies6 August 2019 at 00:24

    Excellent blog thanks for sharing Run your salon business successfully by tying up with the best beauty shop in Chennai - The Pixies Beauty Shop. With tons of prestigious brands to choose from, and amazing offers we’ll have you amazed.

    ReplyDelete
  27. Unknown6 August 2019 at 00:44

    Awesome blog thanks for sharing While choosing your perfect ride for driving, Accord Cars comes with and the best packages for you to pick from. Car rentals for self drive in Chennai are done the easier. Just pick out your plan from hourly, daily, weekly and even monthly plans available.

    ReplyDelete
  28. Unknown6 August 2019 at 00:59

    Very useful blog thanks for sharing With over a three decade of beauty expertise at our fingertips, we believed that everyone has the right to be beautiful. And so began the journey of our very own Pearl’s Beautician course in Chennai.

    ReplyDelete
  29. easylearn22 August 2019 at 02:30

    Hi, thank you very much for new information, i learned something new. Very well written.It was so good to read and usefull to improve knowledge.Keep posting. If you are looking for any big data hadoop related information please visit our website.
    big data hadoop training in bangalore.

    ReplyDelete
  30. Anbarasan1427 August 2019 at 04:49

    I have been reading all your blogs regularly..I admit, this is one of the best blogs I have read till date. Great going.. Waiting for the next...
    Spoken English Classes in Chennai
    Spoken English in Chennai
    Top 10 Spoken English Classes in Chennai
    Best IELTS Coaching in Chennai
    IELTS Coaching Centre in Chennai
    English Classes in Mumbai
    English Speaking Classes in Mumbai
    Best IELTS Coaching in Mumbai
    IELTS Coaching in Mumbai
    Spoken English Class in Anna Nagar

    ReplyDelete
  31. Rakesh17 September 2019 at 04:29

    Fabulous post admin, it was too good and helpful. Waiting for more updates.
    Tally course in Chennai
    Tally Training in Chennai
    Tally institute in Chennai

    ReplyDelete
  32. balamurugan4 October 2019 at 23:07

    Thanks for the informative article. This is one of the best resources I have found in quite some time.
    Hadoop Admin Training in Chennai
    Hadoop Administration Course in Chennai
    TOEFL Coaching in Chennai
    French Classes in Chennai
    pearson vue test center in chennai
    Informatica Training in Chennai
    spanish language in chennai
    content writing training in chennai
    Hadoop Admin Training in Adyar
    Hadoop Admin Training in Velachery

    ReplyDelete
  33. Laura Bush5 October 2019 at 03:39

    asdfgh

    ReplyDelete
  34. Venkatesh CS6 October 2019 at 04:26

    Thanks for sharing valuable information.
    Digital Marketing training Course in chennai
    digital marketing training institute in chennai
    digital marketing training in Chennai
    digital marketing course in Chennai
    digital marketing course training in omr
    digital marketing certification in omr
    digital marketing course training in velachery
    digital marketing training center in chennai
    digital marketing courses with placement in chennai
    digital marketing certification in chennai
    digital marketing institute in Chennai
    digital marketing certification course in Chennai
    digital marketing course training in Chennai
    Digital Marketing course in Chennai with placement
    digital marketing courses in chennai

    ReplyDelete
  35. The India31 October 2019 at 21:57

    Content Writing Company in Delhi
    Content Writing Services in Delhi
    Mobile App Development Company Delhi
    PPC Company in Delhi
    PPC Company in India

    ReplyDelete
  36. Extensiya19 November 2019 at 01:55

    Awesome blog thankks for sharing 100% virgin Remy Hair Extension in USA, importing from India. Premium and original human hair without joints and bondings. Available in Wigs, Frontal, Wavy, Closure, Bundle, Curly, straight and customized color hairstyles Extensions.

    ReplyDelete
  37. Indpac19 November 2019 at 02:01

    Very useful blog thanks for sharing IndPac India the German technology Packaging and sealing machines in India is the leading manufacturer and exporter of Packing Machines in India.

    ReplyDelete
  38. Padminiprwatech3 December 2019 at 22:34

    Thanks for sharing useful information. I learned something new from your bog. Its very interesting and informative. keep updating. If you are looking for any Data science related information, please visit our website Data Science training institute in bangalore

    ReplyDelete
  39. Malcom Marshall21 January 2020 at 06:42

    Nice information, valuable and excellent design, as share good stuff with good ideas and concepts, lots of great information and inspiration, both of which I need, thanks to offer such a helpful information here.

    digital marketing course in chennai
    digital marketing training in chennai
    seo training in chennai
    online digital marketing training
    best marketing books
    best marketing books for beginners
    best marketing books for entrepreneurs
    best marketing books in india
    digital marketing course fees
    best seo service in chennai
    wordpress bundle
    wp starter pack
    digital marketing resources
    digital marketing blog
    digital marketing expert

    ReplyDelete
  40. pavithra dass23 January 2020 at 06:38

    Good job! Fruitful article. I like this very much. It is very useful for my research. It shows your interest in this topic very well. I hope you will post some more information about the software. Please keep sharing!!
    SEO Training in Chennai
    SEO Course in Chennai
    SEO Training Institute in Chennai
    SEO Classes in Chennai
    Best SEO Training in Chennai

    ReplyDelete
  41. pavithra dass23 January 2020 at 06:42

    Good job! Fruitful article. I like this very much. It is very useful for my research. It shows your interest in this topic very well. I hope you will post some more information about the software. Please keep sharing!!
    SEO Training in Bangalore
    SEO Course in Bangalore
    SEO Training Institute in Bangalore
    Best SEO Training Institute in Bangalore
    SEO Training Bangalore
    SEO Training in Madurai
    SEO Training in Coimbatore
    SEO Course in Coimbatore
    SEO Training Courses in Coimbatore

    ReplyDelete
  42. Padminiprwatech4 February 2020 at 20:52

    Thanks for sharing your innovative ideas to our vision. I have read your blog and I gathered some new information through your blog. Your blog is really very informative and unique. Keep posting like this. Awaiting for your further update.If you are looking for any Hadoop related information, please visit our website Hadoop training in Bangalore.

    ReplyDelete
  43. Goutham Raj24 February 2020 at 23:15

    Good Blog, well descrided, Thanks for sharing this information.
    Big Data and Hadoop Online Training

    ReplyDelete
  44. rainbowr10 March 2020 at 04:05

    good blog

    Spark and Scala Online Training

    ReplyDelete
  45. jamuna30 March 2020 at 01:54

    This is good information and really helpful for the people who need information about this.
    German Classes in Chennai
    german language course
    best spoken english institute in chennai
    Japanese Language Course in Chennai
    top 10 ielts coaching in chennai
    ielts exam coaching centre in chennai
    Spoken English in Chennai
    TOEFL Training in Chennai
    spanish courses in chennai
    content writing course in chennai
    German Classes in Adyar
    German Classes in T Nagar

    ReplyDelete
  46. Nisha Sharma30 March 2020 at 03:57

    Mobile app development company in mumbai

    ReplyDelete

Post a comment

Popular posts from this blog

Software Architect and Software Architecture

What is Software Architecture? Software Architecture is the structure of a software system, it's fundamental properties and the principles of its design and evolution. Structure: It is about identifying the architecturally significant pieces of a system and defining the relationship between them. Properties: It is about the functional properties of a system and its quality properties like performance, scalability, security, etc. Principles: It is about understanding the principles behind its design. An understanding that allows the system to evolve in a consistent and logical way without introducing unnecessary complexity. What is the importance of Software Architecture? The need for Software Architecture is best summarized in the following statement: "Software architecture represents a system's earliest set of design decisions. These early decisions are the most difficult to get correct and the hardest to change later in the development process, and they have the most far-reac…
Read more