Japan Chief Architect
- Location
- Tokyo Prefecture, Japan
- Employment
- Full Time
- Work model
- On-Site
- Level
- Senior
- H-1B history
- 4 approvals (FY2023)
- Posted
Skills
About this role
SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. At the core of SambaNova's technology is the RDU (Reconfigurable Dataflow Unit) — a chip built on a dataflow architecture rather than the traditional GPU model. Its decode performance is especially strong for agentic workloads like multi-turn agents, code generation, and long-running applications. RDUs are packaged into SambaRack, rack-scale hardware that lets customers deploy state-of-the-art models with better performance, greater energy efficiency, and faster time to value.
We are building a next-generation AI inference accelerator and the rack-scale system around it, in Japan, on a leading-edge domestic 2nm process. The work is funded through a multi-year national programme to establish sovereign AI infrastructure, and runs from architecture definition through test silicon, full chip tape-out, and deployment of production racks.
We are looking for the architect who will define the chip and technically lead the team that builds it, working with the US HQ engineering team. You will decide how compute, memory and interconnect are balanced for large language model inference, and what the hardware exposes to the compiler and runtime. You understand the software stack as well as the silicon, and you stay with the architecture through RTL, verification and physical implementation until it works in silicon.
What you will own
• The chip architecture and microarchitecture specification for a reconfigurable dataflow accelerator: tile architecture, on-chip network, memory hierarchy, and the execution model that maps AI workloads onto them.
• The hardware and software interface: the programming model, control interfaces, and the assumptions the compiler and runtime are allowed to make about the hardware.
• Technical leadership of the implementation, from architecture through RTL, verification and physical design, to tape-out and silicon correlation.
Responsibilities
Architecture definition
• Define the chip and system architecture against inference performance requirements: tokens per second per user, aggregate throughput, and tokens per second per watt.
• Use performance models and architectural simulations to decide trade-offs, and keep them calibrated against measured silicon as it becomes available.
• Make the balance calls across compute capability, memory bandwidth and interconnect bandwidth, and defend each one with data.
Hardware and software co-design
• Work directly with compiler, runtime and model optimization engineers so that the architecture is one the software stack can actually exploit.
• Own the interfaces that software depends on: mapping, scheduling, memory allocation, synchronization, power, and scale-up and scale-out networks.
• Analyse real LLM workloads (attention, KV cache, quantized and low-precision arithmetic, batching) on the architecture, and feed the results back into both the hardware and the software.
Technical leadership of implementation
• Lead the team technically from specification to tape-out: microarchitecture specs, RTL design reviews, block interfaces, clocking, reset and power domains.
• Set verification goals with the verification lead, and ensure performance correlation between the architectural model and the RTL.
• Assess physical feasibility early and keep the design within it: area and timing budgets, floorplan partitioning, power, thermal limits, and die and package size.
• Lead technical design reviews at each integration milestone, and give the technical sign-off for tape-out.
• Support