Data Engineer

Title : Data Engineer

Location: On-Site in Northern Virginia Area

Type: Direct Hire

Position Overview: A Data Engineer to support development for data ingest, data Extraction, Transformation and Load (ETL), data mapping, analytical support, operational support, data quality, and maintenance support of systems. This position requires all work be performed full-time onsite at the client location in the Northern Virginia area. All candidates must possess a TS/SCI with polygraph security clearance to qualify.

Key Responsibilities:

• Work with customers to translate operational needs into technical requirements.

• Track program progress, risks, issues, and dependencies.

• Support technical meetings to communicate program and mission requirements and provide technical advice and direction based on practical knowledge

• Interact with the Sponsor's Enterprise teams to integrate Sponsor's mission data within enterprise applications, to include using Amazon EC2, S3, and related services.

• Write ad-hoc code on very short timelines to address new circumstances.

• Support downstream systems and capabilities of external Sponsor organizations dependent on the Sponsors data platform via various approaches, to include application programming interfaces (APIs).

• Develop integration plans that capitalize on new data processing, modeling, and storage technologies including the cloud environments.

• Deliver new methodologies, solutions, capabilities, and products to derive more and accurate value from data.

• Evaluate data collections to assess the potential value-add to the Sponsors data platform to recommend to the Sponsor and ensure data transformation across the pipeline results in accurate results.

• Generate assessments about data, support activities to perform data acquisition and engineering, and enable the processing of data so it is integrated into data platform systems for maximum value.

• Sustain and with Sponsor's oversight, evolve and modernize the intermediate data models to grow and advance their use by downstream systems and capabilities dependent on the Sponsor's data.

• Perform and support data modeling and engineering activities for integration of new data into the Sponsor's data platforms data corpus.

Required Qualifications:

• Possess an active TS/SCI with polygraph security clearance.

• Experience developing and using data processing technologies (e.g., Python, SPARK, Java, SQL, Jenkins, PyPi, Terraform, Cloudera, ElasticSearch, Pentaho, Apache NiFi, Apache Hop) to perform data processing, and to develop, validate, and use methodologies to support analytic requirements in Clustered Computing environments.

• Demonstrated experience with SQL and stored procedure languages such as PL/SQL.

• Demonstrated experience with Regular Expressions.

• Demonstrated experience programming using languages such as Bash.

• Demonstrated experience with AWS S3.

• Demonstrated experience working with data in scripts such as Unicode.

• Demonstrated experience extracting, transforming and loading data from disparate structured data formats into enriched, query-friendly structured data in indexed files.

• Demonstrated experience developing, validating, and using methodologies to support analytic requirements in Clustered Computing environments.

• Demonstrated experience performing data quality analysis.

• Demonstrated experience gathering information to determine data sources.

• Demonstrated experience developing ETL design documentation including source and target mapping and data dictionary information.

• Demonstrated experience with Linux operating systems.

Desired Qualifications (NOT REQUIRED):

• Demonstrated experience with data analytics capabilities of SPLUNK.

• Demonstrated experience with Amazon Web Services' native data science capabilities.

• Demonstrated experience understanding the flow of data across the Sponsor's enterprise data warehouses.

• Demonstrated experience using Enterprise Control Language (ECL) and the Lexis-Nexis High Performance Cluster Computing (HPCC) platform.

All qualified applicants will receive consideration for employment without regard to race, color, national origin, age, ancestry, religion, sex, sexual orientation, gender identity, gender expression, marital status, disability, medical condition, genetic information, pregnancy, or military or veteran status. We consider all qualified applicants, including those with criminal histories, in a manner consistent with state and local laws, including the California Fair Chance Act, City of Los Angeles' Fair Chance Initiative for Hiring Ordinance, and Los Angeles County Fair Chance Ordinance. For unincorporated Los Angeles county, to the extent our customers require a background check for certain positions, the Company faces a significant risk to its business operations and business reputation unless a review of criminal history is conducted for those specific job positions.