Senior Software Engineer (big data)
Tasks
- Architect and evolve data pipeline
- Build large-scale data pipelines
- Collaborate with data science and research teams
- Collect aggregate analyze data at scale
- Deliver security ratings using rating algorithm
- Ensure reliability and scalability of pipeline
- Ingest security intelligence data
- Integrate new data sources
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Algorithms | Apache Iceberg | Apache Spark | CI/CD | Data Lakehouse | Data Structures | Data Warehouse | Elasticsearch | Hadoop | Java | Kubernetes | OLAP | OpenSearch | Python | Starrocks
Education
N/A
Roles
Big Data Engineer | Data Engineer | Engineer | Software Engineer
Related jobs
-
Security Engineer ZAR 900K-1000KAWS | AWS EKS | AWS GuardDuty | AWS Security | AWS Security HubAutonomy and empowerment | Collaborative environment | Encouraging team environment | Flexible work practices | Learning SupportMid-level Full TimeKenya; Portugal; South Africa R12h ago
-
Security Engineer, Data Protection - Associate EUR 44K-67KAccess Control | Access Control Lists | Address translation | Automation | CASBEmployer paid dental insurance | Employer-paid health insurance | Paid time off | Professional development and certifications | Remote workMid-level Full TimeLisbon, Portugal R5d ago
-
Application Security Engineer PLN 222K-334KAWS | AWS GuardDuty | Access Control | Access Management | Amazon EKSKind co-workers | Team bonding events | Work-life balanceMid-level Full TimeRemote (Portugal) R12d ago
-
AWS Cloud Engineer (m/f/d) EUR 39K-67KAWS | AWS CloudFormation | Bash | CI/CD | DockerCorporate discounts | Dog-friendly office | Flexible hours | Local meetups | Referral bonusesMid-level Full TimePortugal Remote R13d ago
-
Security Compliance Engineer EUR 54K-79KAWS IAM | Amazon Web Services | As-a-Service | Azure | CIS ControlsOne on one manager support | Remote work support | TrainingMid-level Full TimePortugal R19d ago
-
AKS | Aqua Security | Azure DevOps | Azure Key Vault | BashContinuous improvement | Full remote | High trust engineering culture | Ownership focused workSenior-level Full TimeLisbon, Portugal R19d ago
-
AEM | Adobe Experience | Adobe Experience Manager | Azure DevOps | CDNFull remote | Portugal remote workMid-level Full TimeLisbon, Portugal R19d ago
-
Cloud Security Engineer - Assistant Vice President EUR 93K-135KAWS | Application Security | Automation | Azure | Cloud SecurityEmployer paid dental insurance | Employer-paid health insurance | Fully remote | Paid time offExecutive-level Full TimeLisbon, Portugal R21d ago
-
Cloud Security Engineer II (AWS) EUR 70K-85KAWS | AWS CloudTrail | AWS Lambda | AWS Security | AWS Security HubDonation matching | Employee assistance program | Flexible schedule | Health benefits | Lifestyle benefitMid-level Full TimeLisbon R1mo ago
-
Senior Software Engineer EUR 100K-129KAWS | Algorithms | CI/CD | Data Structures | DjangoInclusive culture | Professional growth opportunitiesSenior-level Full TimeRemote Portugal R1mo ago
-
Senior Software Engineer EUR 100K-129KAWS | Algorithms | CI/CD | Cloud Computing | ContainerizationFlexible work arrangements | Inclusive culture | Professional growthSenior-level Full TimeRemote Portugal R1mo ago