Big Data Engineer

Description

We are offering a long term contract employment opportunity for a Big Data Engineer in the FinTech industry, for our client based in ITASCA, Illinois. In this role, you will be working on complex data processing tasks, maintaining data integrity and ensuring optimal performance of our data systems. The main focus for this project will be upgrading MapR clusters, so administration experience is a huge help! This role can be 100% remote but local to Itasca is preferred.

Responsibilities:

Develop and maintain robust Hadoop ecosystems to support large scale data processing

Utilize Linux shell scripting and administration skills to streamline and automate processes

Write Python scripts to automate data extraction and manipulation tasks

Work with Apache Spark for query execution and optimization

Utilize Apache Hadoop for data storage and retrieval

Apply knowledge of cloud technologies and Agile Scrum methodologies to enhance project delivery

Develop and maintain APIs for data exchange between different systems

Utilize Apache Kafka, Apache Pig, and Apache Cassandra for data ingestion and processing

Implement automation strategies to reduce manual intervention in data processing tasks

Leverage Hadoop administration skills for system configuration and maintenance.

Requirements

Possess extensive knowledge of Big Data tools such as Apache Cassandra, Apache Kafka, Apache Pig, Apache Spark, and Hadoop.
Proficiency in programming languages such as Python and Linux.
Experience in Hadoop administration and API development.
Familiarity with Agile Scrum methodologies.
Demonstrable experience in automation and Python scripting.
Strong understanding of cloud technologies.
Proven analytic skills to interpret and handle complex data.
Ability to work collaboratively in a team environment.
Excellent problem-solving skills and attention to detail.
Good communication skills, both verbal and written.
Relevant industry qualifications or equivalent work experience in FinTech.
A commitment to ongoing professional development.
Ability to handle multiple tasks and prioritize effectively.
High degree of professionalism and a strong work ethic.

Technology Doesn't Change the World, People Do.

Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.

All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

2024 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use.