Speech AI Engineer

About VORTO

Vorto is on a mission to increase sustainability and create more jobs by making supply chains more efficient across the entire value chain. Through powerful AI technology, Vorto's autonomous supply chain platform seeks to reduce carbon emissions caused by supply chain transportation, improve the lives of approximately 3.5 million truck drivers and create more jobs across all players in B2B transactions. We operate in a very fast-paced and nimble environment that is highly focused on a team-first, accomplishment-oriented culture that is passionate about the organization's success.

Our products have been developed by a world-class engineering team that simplifies complex business problems to a degree where adoption is effortless. We encourage you to visit our careers page and read this blog post to learn more about our culture.

What You'll Do

Own the Speech interface layer: real-time speech-to-intent pipeline using models like Whisper or Deepgram

Build conversational UX flows for tasks like:

Load search and booking

Navigation and status updates

Voice journaling and micro-coaching

Optimize for real-world conditions: noisy cabs, unreliable signal, driver interruptions

Design fallback logic and graceful failure handling when voice commands are ambiguous or partial

Develop personalization features to learn and adapt to each driver’s preferences, tone, and goals over time

Personalization Responsibilities

You’ll lead the design of systems that help the assistant become a

relationship-level tool, not just a command engine:

Build a driver memory graph to store goals, language patterns, habits, and personality traits

Develop logic for driver-specific intent recognition and natural phrasing (e.g., “get me home this weekend”)

Implement adaptive prompting based on driver profile tags (e.g., preferred tone, motivational style)

Enable the system to reference past conversations, track personal milestones, and make coaching feel deeply contextual and human

Use retrieval-augmented generation (RAG) or custom embeddings to let the assistant "remember" and evolve

Technologies You Might Use

Speech: Whisper, Deepgram, Google Speech-to-Text

NLU / LLMs: GPT-4o, Rasa, LangChain, custom intent parsers

Frontend: React Native (for fallback UI), WebRTC, Twilio Voice

Infra: Node.js, Python, Firebase, Supabase, Postgres, Pinecone

You Might Be a Fit If You

Have built or contributed to voice or AI-driven products with personalization or memory features

Understand the difference between "generic commands" and relationship-based coaching

Know how to ship fast, but keep latency and UX top of mind

Are excited to build tools that respect and elevate working-class users

Are obsessed with human-first AI design

Benefits

At VORTO we are committed to developing our employees and providing them exciting opportunities to grow and prosper in their careers. We encourage you to visit our careers page and read this blog post to learn more about our culture.

We offer a competitive benefits package as well as numerous additional perks including:

Competitive compensation package

Health, Dental and Vision Insurance

401k with matching

Company paid life and short-term disability insurance

Company paid parking or transit pass

Relocation offered when applicable

Modern office space in downtown Denver

Daily coffee, tea, drinks & snacks

Team happy hours

VORTO is an Equal Opportunity Employer.

This position will be posted until a qualified candidate is hired.

Disclaimer: This job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee. Other duties, responsibilities and activities may change or be assigned.