spark developer

Job Description:

Hello ,

Greetings from MM Management !! I am krishna kanth from MM Management, MM Management is into global recruitment services providing manpower across the globe.

About company- global consulting company offering solutions, services and platforms on Open Source, Cloud and Automation technologies. Since 2000, the company has been delivering enterprise class solutions, which are built using leading platforms & can easily be integrated with existing systems to achieve unparalleled results. 

Work from home on contract for around 6 months

Work location: Remote

Experience: 6+Years

Job Description:

Roles And responsibilities of Cloudera & spark developer

Secure data management and portable cloud-native data analytics delivered in an open, hybrid data platform. Whether you're powering business-critical AI applications or real-time analytics at scale, Cloudera data platform enables your business to do anything with your data, anywhere, securely.

What is Cloudera enterprise? enterprise platform for big data. Cloudera enterprise includes CDH, the world’s most popular open source Hadoop-based platform, as well as advanced system management and data management tools plus dedicated support and community advocacy from our world-class team of Hadoop developers and experts.

Responsibilities -

• Over all 6 to 10 years of experience with data management, big data, data warehousing and analytics
•  At least 3 to 6 years of experience in developing and implementing big data Solutions
•  At least 5 years of hands-on experience with Cloudera implementation of Hadoop technologies such as Map Reduce,Spark
•  4 years of experience in building high performance ETL/ELT jobs using spark framework
• Strong experience working with high velocity and high volume data,including good experience in handling relational, semi-structured, and unstructured data (mandatory to have Big data experience)

• Experiencing in Injecting the data into Hadoop cluster from external sources such as Oracle, SQL etc.
•  Strong Python with Pyspark experience is MUST
•  Should be able to demonstrate work experience in hive/Impala and Spark, PySpark. 
•  Familiar with framework-based data ingestion and engineering
•  Experience with data process Orchestration, end-to-end design and build process of Near-Real Time and Batch Data Pipelines
•  Strong client-facing communication and facilitation skills
•  Hadoop focused developer with focus on BI and data analysis
•  Strong spark hands on skill a must. Very Strong SQL skills.
•  Working knowledge of shell scripting and bash
•  Working experience in AWS platform and familiar with s3, Redshift is desirable 
•  Good knowledge of Hadoop Cluster Architecture and hands-on experience within Cloudera Hadoop ecosystems

Soft Skills -

• Willing to work supporting USA Timezone / overlap USA timezone
• Excellent communication and collaboration skills
• Excellent interpersonal skills and the ability to work in a team environment
• Strong communication skills in English, both written and spoken
• Strong in Agile-Development
• Strong analytical and troubleshooting skills

If interested please fill the details below and revert back with your updated CV on cv@m3consultant.net

1. Total experience
2. How many years of experience do you have as an Cloudera & spark developer ?
3. How many years of experience do you have in big data Solutions ?

4. How many years of experience do you have in Hadoop
5. How many years of experience do you have in Python and Pyspark? ?
6. Notice period
7. Current location
8. Current company name
9. Current salary
10. Expected salary

• Are you ready to work in a contractual position?