Hadoop Lead

Company Description Ventures Unlimited is a service centric organization. Our success begins with our ability to apply our relationships, leverage technologies, and identify talent - often in combination - to an endless array of real-world customer needs

Job Description

**** FULL TIME PERMANENT POSITION******

Position : Hadoop Lead with Python Location: Beaverton, OR Duration: Full Time

Job Description :

Responsibilities:

• Design and implement map reduce jobs to support distributed processing using java, python, hive and pig; Ability to design and implement end to end solution.
• Build libraries, user defined functions, and frameworks around Hadoop
• Research, evaluate and utilize new technologies/tools/frameworks around Hadoop eco system
• Develop user defined functions to provide custom hive and pig capabilities
• Define and build data acquisitions and consumption strategies
• Define & develop best practices
• Work with support teams in resolving operational & performance issues
• Work with architecture/engineering leads and other teams on capacity planning
• Work with Site-Operations team on configuration/upgrades of the cluster
• Excellent communication skills

Qualification:

• MS/BS degree in a computer science field or related discipline
• 8+ years’ experience in large-scale software development
• Experience with data warehousing, dimensional modeling and ETL development
• Strong Java programming, shell scripting, Python, and SQL
• Strong development skills around Hadoop, MapReduce, Hive, Pig, Impala
• Strong understanding of Hadoop internals
• Good understanding of AVRO and Json
• Experience with build tools such as Maven
• Experience with databases like Oracle;
• Experience with performance/scalability tuning, algorithms and computational complexity
• Experience (at least familiarity) with data warehousing, dimensional modeling and ETL development
• Ability to understand and ERDs and relational database schemas
• Proven ability to work cross functional teams to deliver appropriate resolution
• Experience with open source NOSQL technologies such as HBase and Cassandra
• Experience with messaging & complex event processing systems such as Kafka and Storm
• Machine learning framework (Nice to have)
• Statistical analysis with Python, R or similar

Qualifications

• MS/BS degree in a computer science field or related discipline
• 8+ years’ experience in large-scale software development
• Experience with data warehousing, dimensional modeling and ETL development
• Strong Java programming, shell scripting, Python, and SQL
• Strong development skills around Hadoop, MapReduce, Hive, Pig, Impala

Additional Information Contact "Mohit Maurya" for more details at 856-842-1988 Ext:141