Senior Software Engineer
San Francisco Bay Area
RadiantSecurity
Radiant Security is an AI-powered SOC co-pilot that boosts SOC analyst productivity, detects real attacks, & improves response times.Join the Future of Cybersecurity with Radiant Security’s AI Revolution
Are you ready to dive into the world of Generative AI and be part of the team that’s transforming how security operations are done? At Radiant Security, we’re not just creating tools—we’re pioneering the industry’s first AI SOC Analyst, built to think and act like a top-tier security expert. Here, you’ll have the unique opportunity to learn and grow with cutting-edge AI technology. Our AI uses advanced algorithms to analyze security alerts, performing hundreds of dynamic tests in just minutes to deliver detailed incident reports, root cause analysis, and custom response plans. By the time an alert reaches a human analyst, the heavy lifting is done—they know whether it’s real, what caused it, and how to fix it.
As part of the Radiant team, you’ll work directly with this groundbreaking technology, learning how to harness its power to transform SOC workflows. Whether you’re looking to expand your skills in AI-driven automation, decision-making, or cybersecurity as a whole, Radiant Security is the place to grow and thrive
This is a hybrid position and we are attending the offices 3 times a week. We have offices in Pleasanton, California and São Paulo, Brazil.
About the Role:
As a Senior Software Engineer at Radiant Security in the Fabric Services team, you will be responsible for architecting and maintaining our enterprise data lake infrastructure. You'll work on building robust data lake solutions that enable efficient data ingestion, processing, and analytics at petabyte scale. Your focus will be on developing cloud-native data lake architectures that support both batch and real-time processing while ensuring data governance, security, and accessibility.
Key Responsibilities:
- Design and implement modern data lake architectures using technologies like Apache Iceberg, Delta Lake, or Apache Hudi for efficient data management and ACID transactions
- Develop data lake ingestion frameworks supporting multiple data formats (Parquet, ORC, Avro) and implementing medallion architecture (bronze, silver, gold layers)
- Build automated data quality and governance solutions for data lake environments, including metadata management, data cataloging, and lineage tracking
- Optimize data lake performance through partitioning strategies, compaction policies, and query optimization techniques
- Implement data lake security controls including fine-grained access control, encryption, and audit logging
Skills and Qualifications:
- Advanced programming skills with experience building large-scale data processing applications and ETL pipelines (we use NodeJS, Golang, and Python)
- Extensive experience with data lake technologies including Apache Iceberg, Delta Lake, or Apache Hudi, and modern lakehouse architectures
- Expertise in cloud data platforms including AWS Lake Formation, Azure Data Lake Storage, or GCP, along with their respective query engines (Athena, Synapse Analytics, BigQuery)
- Strong background in data processing frameworks such as Apache Spark, Apache Flink, or Apache Beam, with experience in both batch and streaming architectures
- Proven experience with data governance and optimization, including implementing data quality frameworks, metadata management, access controls, and performance tuning strategies
Nice to Have:
- Hands-on experience in containerization and orchestration (Docker, Kubernetes) for deploying scalable data services.
- Previous work orchestrating deployments of new infrastructure using IaC in terraform
Why Join Us?
Beyond the challenging data and platform engineering problems and working with a high-caliber engineering team, working at Radiant is major opportunity to impact security teams by reducing their workload and mitigating security incidents quickly. Come help shape a future where people can sleep more easily due to a smaller blast radius of cyber threats.
The process:
- People team interview
- Coding interview
- Architecture Testing
- Virtual On Site: Leadership interviews
Radiant Security participates in E-Verify for US employees. We will provide the US Social Security Administration and the US Department of Homeland Security with information from each new employee’s Form I-9 to confirm work authorization. Please note that we do not use this information to pre-screen job applicants.
* Salary range is an estimate based on our InfoSec / Cybersecurity Salary Index 💰
Tags: Analytics Automation AWS Azure Cloud Docker Encryption GCP Generative AI Golang Governance Kubernetes Node.js Python SOC Terraform
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.