Senior Software Engineer, Data Pipelines
Tasks
- Apply AI to democratize biosecurity data
- Build APIs and microservices in Python
- Build and optimize cloud-based data workflows
- Build scalable biological data pipelines
- Create real-time and batch data access solutions
- Design and deploy data warehouses
- Develop data models and documentation
- Diagnose and improve system performance
- Ensure data integrity and governance
- Lead data projects and collaborate with stakeholders
Perks/Benefits
Skills/Tech-stack
AI | API Development | AWS | Airflow | CI/CD | CloudFormation | DBT | Data Governance | Data Modeling | Data Quality | Docker | ELT | ETL | FastAPI | Git | Kubernetes | LLMs | Monitoring | Observability | Performance Tuning | Python | SQL | Snowflake | Terraform
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
API | Access Control | Management systems | Network Engineering | PythonSenior-level Full TimeSan Jose, California11h ago
-
Privacy Engineer USD 160K-180KBy Design | Cloud infrastructure | Code review | Data Mapping | Data RetentionEntry-level Full TimeSan Francisco Bay Area11h ago
-
Principal Analyst Cyber Security Operations - SOAR USD 117K-196KAPI Integration | Anomaly Detection | Azure DevOps | Behavioral analytics | CI/CD401k company match | Dental insurance | Medical insurance | Paid time off | Parental leaveSenior-level Full TimeWaltham, MA, United States12h ago
-
Staff Software Engineer - Identity and Privacy USD 211K-292KAccess Controls | Anonymization | Apache Kafka | Asynchronous processing | Authentication401k company match | Dental insurance | Dependent care FSA | Fertility benefits | Flexible PTOSenior-level Full TimeNew York, NY12h ago
-
Security Engineer USD 200K-400KAPI Security | AWS | Access Control | Access Management | Application Security401k plan | Medical/Dental/Vision insurance | Parental leave | Sick leave | Unlimited PTOMid-level Full TimeSan Francisco12h ago
-
Staff Security Architect, Missile Defense USD 200K-290K800-53 | ATO | Application Security | Automated Security Scanning | Automated security401k | Conference support | Dental insurance | HRA/HSA options | Health insuranceSenior-level Full TimeDenver, CO and Long Beach, CA13h ago
-
Staff Security Engineer, Proactive Security USD 193K-285KAWS | CI/CD | Cause analysis | Distributed Systems | Distributed Systems Security401k with employer matching | Basic life insurance | Commuter benefits match | Disability insurance | Family-forming assistanceSenior-level Full TimeUnited States - Remote R13h ago
-
Support Engineer USD 78K-117KAPIs | AWS | Azure | Change Management | DockerCareer development | Distributed team collaboration | Learning opportunities | Night and weekend shift availability | Remote workMid-level Full TimeUnited States R14h ago
-
Software Engineer USD 135K-200KAPI Design | API Development | AWS Lambda | CloudFormation | Code reviewMid-level Full TimeAustin, Texas, United States15h ago
-
Application Security Engineer USD 100K-190KAWS | CI/CD | CIS | CircleCI | Code reviewFamily support | Financial benefits | Health benefitsMid-level Full TimeAmerican Fork, Utah, United States15h ago
-
Senior DevOps Engineer USD 114K-174KCI/CD | Container Orchestration | Containerization | DevOps | DockerMindfulness app membership | Paid parental leave | Paid time off | Remote work | Volunteer day offSenior-level Full TimeUnited States; Remote R15h ago
-
Development Security Operations Engineer USD 130K-150KAPI Security | Active Directory | Ansible | App Service | Application Security401 K | Commuter benefit | Dental insurance | Education assistance | Employee assistance programMid-level Full TimeCamden, New Jersey, United States15h ago
-
AWS | Agent Orchestration | Azure | CNAPP | CSPM401k matching | Medical/Dental/Vision insurance | Paid time off | Wellness programSenior-level Full TimeFoster City, CA, United States16h ago
-
Staff Security Engineer, Application Security USD 169K-255KApplication Security | Go | Incident Response | Python | Secure Development401k matching | Catered meals | Company holidays | Fertility benefits | Flexible benefits spending accountSenior-level Full TimeMenlo Park, CA16h ago
-
ArcGIS Pro | Arcpy | Bokeh | Dash | GDALSenior-level Full TimeTampa, US-FL, US17h ago
-
Senior Systems Engineer USD 120K-145KAWS | Active Directory | Alerting | Azure | Backup and Recovery401k match | Dental insurance | Education assistance | Floating holiday | Health insuranceSenior-level Full TimeCharlotte, North Carolina, United States19h ago
-
Senior Security Engineer USD 180K-225KAmazon Web Services | Cloud platform | Cosign | Data Retention | Data masking401k plan | Dental insurance | Flexible vacation | Health insurance | Life insuranceSenior-level Full TimeSan Francisco, CA19h ago
-
Sr Systems Administrator/Systems Engineer USD 150K-170KConfluence | Elastic | Elastic Stack | Elasticsearch | GrafanaContinuing education | Family support | Healthcare | Learning and development opportunities | RetirementSenior-level Full TimeLinthicum Heights, MD20h ago
-
Lead Software Reverse Engineer USD 154K-231KARM | Assembly | Binary Ninja | Bluetooth | C#Dental insurance | Disability insurance | Life insurance | Medical insurance | Paid leaveSenior-level Full TimeArlington, Virginia21h ago
-
AWS | Azure | BindPlane | Browser Forensics | Cloud SecurityDental insurance | Disability insurance | Family planning support | Health insurance | Life insuranceSenior-level Full TimeNew York21h ago
-
AI | Access Management | Cloud Security | Cybersecurity | Data Architecture401k | Dental insurance | FSA/HSA | Life insurance | Medical insuranceSenior-level Full TimeAustin, TX, United States21h ago
-
AWS CloudFormation | Amazon Web Services | Azure | Bash | CI/CDCorporate holidays | Dental insurance | Flexible time off | Health insurance | Home internet allowanceMid-level Full TimeRemote R22h ago
-
Automation | Capacity Planning | Cloud Computing | Continuous Deployment | Continuous integrationSenior-level Full TimeSan Jose, California, United States23h ago
-
Senior Security Engineer USD 190K-240KAWS | Application Security | CI/CD | Container Security | Containerized applicationsDental insurance | Health insurance | Office lunch | Offsites | OutingsSenior-level Full TimeNew York, New York, United States1d ago
-
AI Security Engineer USD 227KAPI Security | Access Management | Cloud platform | Data exfiltration | Google CloudAnnual travel to operational markets | Charitable donation matching | Coworking stipend for meetups | Fertility assistance | Flexible vacationMid-level Full TimeGhana; Kenya; Spain; United Kingdom; United … R1d ago