Data Engineer

Fort Gordon, GA, United States

Peraton

Peraton drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted and highly...

View all jobs at Peraton

Apply now Apply later

Responsibilities

Peraton seeks a Data Engineer to provide technical contributions to Elasticsearch, Apache NiFi, Apache Kafka, Apache Spark, and Python based extract, transform, load (ETL) data processing pipelines and data quality monitoring using Cyber and Electromagnetic Spectrum (EMS) data. Location:  Fort Eisenhower, GA

Tasks include:

  • Translate (potentially vague) proposed business processes into corresponding automated data pipelines to ensure the right data is available to supported teams at the right location and format.
  • Create, modify, and automate production-grade ETL pipelines and data monitoring tools like Grafana, Prometheus, or Logstash.
  • Communicate with other data and machine learning engineers about combining compressed, JSON, parquet, database, and data lake-based datasets into a cohesive dataset capable of facilitating business processes.
  • Participate in the software development and deployment using Elasticsearch, Apache NiFi, Apache Kafka, Dask, Prefect, or Pachyderm, Apache Spark, Grafana, Markdown.

Qualifications

Required:

  • Minimum of 8 years with BS/BA; Minimum of 6 years with MS/MA.  Will consider HS + 12 years
  • 5+ years of experience, with a focus on experiences that directly relate to deploying and managing Data Science tools in AWS and Azure, and demonstrate practical, hands-on experience with multi-cloud environments 
    • 1+ years of direct technical experience with Apache ecosystem data engineering projects (NiFi, Kafka, Airflow, Spark, Iceberg, etc.)
    • 1+ years of direct technical implementation experience with Python based ETL of JSON, compressed, and columnar datasets

      Experience with Dask, Prefect, Pachyderm, Airflow, or similar Python ecosystem data engineering projects preferred

    • 1+ years of bash or PowerShell scripting

  • Direct technical experience; translating (potentially vague) proposed business processes into corresponding automated data pipelines; direct technical implementation experienced with creating, modifying, and automating production-grade ETL pipelines and data monitoring tools like Grafana, Prometheus, or Logstash.
  • Comfortable with detailed technical communication with other data and machine learning engineers about combining compressed, JSON, parquet, database, and data lake-based datasets into a cohesive dataset capable of facilitating business processes.
  • Expertise in AWS and Azure Platforms. 
    • Must have in-depth knowledge of both AWS and Azure cloud services, with specific skills in implementing and managing services that support DevSecOps workflows, such as container orchestration, serverless computing, and automated deployments.
  • A passion for innovative technology and protecting national defense through responsible software development and deployment
  • Must have experience with the following tools:
    • Elasticsearch
    • Apache NiFi
    • Apache Kafka
    • Apache Spark
    • Dask, Prefect or Pachyderm
    • Grafana
    • Markdown and GitLab Pages based documentation
  • Familiarity with at least one programming language preferred
  • Familiarity with Git preferred
  • Requires a Top Secret SCI clearance with the ability to obtain MEAD
  • U.S Citizen
  • Must be able to conduct in-person meetings at Fort Eisenhower  Government Furnished Equipment will be provided for remote work

Peraton offers enhanced benefits to employees working on this critical National Security program, which include heavily subsidized employee benefits coverage for you and your dependents, 25 days of PTO accrued annually up to a generous PTO cap and eligible to participate in an attractive bonus plan.

Peraton Overview

Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can’t be done by solving the most daunting challenges facing our customers. Visit peraton.com to learn how we’re keeping people around the world safe and secure.

Target Salary Range

$112,000 - $179,000. This represents the typical salary range for this position based on experience and other factors.
Job stats:  5  0  0

Tags: AWS Azure Bash Clearance Cloud DevSecOps Elasticsearch GitLab Grafana JSON Kafka Machine Learning Monitoring PowerShell Prometheus Python Scripting Top Secret

Perks/benefits: Career development Salary bonus

Region: North America
Country: United States

More jobs like this

Explore more career opportunities

Find even more open roles below ordered by popularity of job title or skills/products/technologies used.