E

Software Engineer, Knowledge Engine – Data Infrastructure

exa·Zurich·10.11.2026

 jobs.ashbyhq.com

 
 
Festanstellung80–100%
Job written in
English
Location
Zurich
Work type
On-site

 

The Knowledge Platform team at Exa builds a massive open‑domain knowledge engine that turns web crawls, vendor data sets and APIs into one of the world's largest knowledge graphs, containing hundreds of billions of evidence‑backed claims. As a Software Engineer on the Knowledge Engine, Data Infrastructure squad, you will design and implement the construction pipelines that ingest raw data, transform it into typed graph entities and keep the graph accurate as new information arrives. Your day‑to‑day work will involve continuously synthesising live web crawls, vendor deliveries and off‑web sources into a typed, provenance‑rich graph. You will create versioned, append‑only ingestion flows that handle schema evolution, late‑arriving records and replayable cursors, ensuring every claim can be traced back to its source. The role requires building entity‑resolution and truth‑discovery systems that operate over billions of records, applying blocking, scoring and clustering to produce canonical entities. You will also develop incremental computation over change‑data feeds, making each job idempotent and resumable so the graph remains eventually consistent despite out‑of‑order streams. Finally, you will devise metrics and evaluation pipelines to measure extraction precision, coverage and lineage, pinpointing any source or processing step that introduces errors. The position demands proven experience building and operating large‑scale distributed data pipelines in production that handle petabytes of structured and unstructured data, specifically using Spark on a lake‑house format such as Delta Lake, Iceberg or Hudi. A deep understanding of incremental processing, including change‑data capture, idempotent writes, backfills and reprocessing, is essential. Strong programming skills in Python and at least one systems language are required, together with the ability to read and optimise Spark query plans. A relentless focus on correctness, reliability and data quality is expected. Nice‑to‑have expertise includes work with entity‑resolution, record‑linkage, knowledge‑graph or ontology technologies, as well as large‑scale information‑extraction or truth‑discovery. Familiarity with Lance or other columnar/vector‑native storage formats would also be advantageous. The role offers the chance to shape foundational components of a unique, greenfield system that powers factual question answering at unprecedented scale, within an inclusive, equal‑opportunity environment. What the role asks for: - Built large‑scale distributed data pipelines in production over petabytes - Experience with Spark on lake‑house formats (Delta Lake, Iceberg, Hudi) - Deep knowledge of incremental processing, CDC, idempotent writes, backfills - Strong Python programming skills - Proficiency in at least one systems language - Ability to read and tune Spark query plans - Nice‑to‑have: experience with entity resolution, record linkage, knowledge graphs or ontologies - Nice‑to‑have: experience with information extraction or truth discovery at scale - Nice‑to‑have: familiarity with Lance or other columnar/vector‑native formats

 

 

 

 

 

Kostenlos

Software Engineer: Lebenslauf-Vorlage

Bewirb dich mit einem Lebenslauf im Schweizer Aufbau — mit Beispieltext und den Anforderungen, die Software Engineer-Inserate am häufigsten nennen.

Lebenslauf-Vorlage Schweiz ansehen

Software Engineer: was der Markt gerade verlangt

Software Engineer-Stellen gehören zu den regelmässig ausgeschriebenen Berufen auf SwissJobs.app.

Am häufigsten genannt in Software Engineer-Inseraten:

  • Berufserfahrung12% der Inserate
  • Kundenkontakt9% der Inserate
  • Belastbar / flexibel9% der Inserate
Vorstellungsgespräch als Software Engineer: die häufigsten Fragen →

Weitersuchen

Ähnliche Jobs per E-Mail erhalten