Senior Data Engineer (1043) - DataSF - Office of City Administrator
San Francisco, CA, United States
USD 145K-159K (estimate) Entry-level Full Time
Tasks
- Administer Snowflake data warehouse
- Build and maintain data infrastructure
- Collaborate with data scientists analysts and engineers
- Create data models and SQL optimization
- Design data pipelines
- Develop Infrastructure as Code with Terraform
- Ensure data quality and availability
- Implement access control and security policies
- Ingest and structure batch and streaming data
- Manage data monitoring and troubleshooting
- Perform performance tuning and cost optimization
- Use dbt for data transformation
- Write tests and maintain documentation
Perks/Benefits
Skills/Tech-stack
Airflow | Azure Data | Azure Data Factory | Batch Processing | BigQuery | DBT | Dagster | Data Factory | Data Governance | Data Modeling | Data Privacy | Data Security | Databricks | ELT | Infrastructure as Code | Kafka | Kinesis | Pandas | PySpark | Python | SQL | Snowflake | Snowpipe | Streaming Data | Terraform | “as-code”
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Senior Security Engineer USD 215K-272KAWS | AWS Config | AWS Firewall | AWS Firewall Manager | AWS IdentityAnnual learning and development stipend | Company lunches and team events | Learning and career development opportunities | Linux laptop | Mental health and wellness supportSenior-level Full TimeOakland, California, United States6h ago
-
Security Software Engineer, IAM USD 208K-312KAWS IAM | Access Management | Access Review | Access Review Automation | DeprovisioningEvent support | Flexible time off | Inclusive healthcare package | Mentorship | Remote work optionSenior-level Full TimeRemote - United States R8h ago
-
Azure Cloud Engineer USD 145K-165KAKS | Azure AD | Azure ExpressRoute | Azure Functions | Azure Key Vault401k matching | Bereavement leave | Employee assistance program | Employee discount program | Health, dental, and vision insuranceMid-level Full TimeWashington D.C., United States15h ago
-
AI Security Engineer USD 140K-170KAI Act | AI RMF | Access Logging | Agent Orchestration | Anomaly Detection401(k) plan matching | Bereavement leave | Employee assistance program | Employee discount program | Health, dental, and vision careSenior-level Full TimeRemote - Nationwide, United States R15h ago
-
Security Solutions Principal - AI Security USD 153K-191KAI RMF | AI Security | API Security | Access Management | Adversarial Attacks401k matching | Employee assistance program | Employee discount program | Employee wellness programs | Health and wellbeing benefitsSenior-level Full TimeRemote - Nationwide, United States R15h ago
-
Systems Automation Engineer USD 120K-190KActive Directory | Ansible | CI/CD | DNS | DevOps401k matching | Bereavement | Employee assistance program | Health dental vision care | HolidaysMid-level Full TimeSan Diego, CA, United States15h ago
-
Mid-level Full TimeRTP, North Carolina, USA Office (NOCAROLINA)17h ago
-
Access Management | Accessibility | Automation | Bulk data | Bulk data pipelinesSenior-level Full TimeNew York, NY, USA; Austin, TX, …21h ago
-
Software Engineer, External API Security USD 147K-211KAccess Management | Automated refactoring | Go | Identity and Access Management | Identity and accessMid-level Full TimeNew York, NY, USA21h ago
-
Agile | Azure DevOps | Bash | CI/CD | DockerDental insurance | Health and wellness benefits | Medical insurance | Paid time off | Remote workMid-level Full TimeLittleton, CO, US1d ago
-
Agile | Azure DevOps | Bash | CI/CD | ContainerizationDental insurance | Health and wellness benefits | Medical insurance | PTO | Remote workMid-level Full TimeNatick, MA, US1d ago
-
Agile methodologies | Azure DevOps | Bash | Branching Strategies | CI/CDDental insurance | Health and wellness benefits | Medical insurance | Paid time off | Remote workMid-level Full TimeTampa, FL, US1d ago
-
Agile | Azure DevOps | Bash | Branching | CI/CDDental insurance | Health and wellness benefits | Medical insurance | PTO | Pre employment background screeningMid-level Full TimeSpring Lake, NC, US1d ago
-
Agile methodologies | Azure DevOps | Bash | Branching strategy | CI/CDDental insurance | Health and wellness benefits | Hybrid work schedule | Medical insurance | Paid time offMid-level Full TimeSPRINGFIELD, VA, US1d ago
-
Staff Security Engineer - Product Security USD 230K-275KAI Risk Management Framework | Access Control | CI/CD | CI/CD hardening | Cloud SecurityHybrid work | Medical, dental, and vision insurance | Paid time offSenior-level Full TimeSouth San Francisco, California, USA1d ago
-
Principal Cloud Engineer USD 152K-166KAmazon Web Services | Ansible | Artifactory | Automation as Code | CI/CDSenior-level Full TimeTwo Destiny Way, Westlake TX, United …1d ago
-
Senior-level Full Time100 New Millennium Way, Bldg 1, …1d ago
-
Principal Software Engineer/Developer USD 153K-166KAWS Aurora | AWS Identity | AWS Identity and Access Management | Access Management | Amazon EKSSenior-level Full TimeOne Destiny Way, Westlake TX, United …1d ago
-
Principal Software Engineer/Developer USD 155K-181KAPI Gateway | AWS KMS | AWS Lambda | Access Management | AgileSenior-level Full TimeTwo Destiny Way, Westlake TX, United …1d ago
-
AI Threat Detection Engineer, Senior Specialist USD 140K-200KAPIs | AWS | Automation | Cyber Threat | Cyber Threat DetectionHybrid work model | Mentorship and trainingSenior-level Full TimeMalvern, PA, United States1d ago
-
Cybersecurity USD 154K-230KAWS Lambda | Agile | Amazon EKS | Amazon S3 | Amazon VPC401k match | Dental insurance | Employee assistance program | Health insurance | Paid time offSenior-level Full TimeBOSTON, United States1d ago
-
Senior-level Full Time100 New Millennium Way, Bldg 2, …1d ago
-
Senior Associate Security Engineer (API) USD 110K-145K800-53 | 800-63 | API Security | API Security Top 10 | Akamai401k | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeAtlanta GA - 303 Peachtree Center …1d ago
-
ACME | API | Ansible | Apache | CI/CD401k plan | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeCharlotte NC - 2320 Cascade Pointe …1d ago
-
Senior. Principal Platform DevSecOps Engineer (Onsite) USD 132K-251KAWS | Ansible | Artifactory | Bash | CI/CDSenior-level Full TimeUS-CO-AURORA-S75 ~ 16800 E Centretech Pkwy …1d ago