Product Overall Introduction

Based on DuerOS, the world’s first human-vehicle dedicated AI system, it provides solutions including human-vehicle dialogue, facial log-in, fatigue driving monitoring, AR navigation, intelligent security, vehicle to home (V2H) and personalized services & contents.

Voice assistant comprehension abilities

Listening, companionship, entertainment, service.

Industry-leading voice-identifying ability and analytical ability realize whole-voice operation, focusing on driving scenarios to greatly satisfy users’ various in-car demands & personalized services.

Functions & Superiorities:

1. Multi-round and interrupted dialogue: supports 5+ rounds of Q&As, interrupting dialogue at any moment;

2. Precise voice wake-up: wakes up sleeping devices and enables them into stand-by mode by using wake-up words;

3. Noise-cancelling matrix: high recognition ratio in highway & open-window scenarios;

4. Emotional express: selects preferred TTS to better communicate with people;

5. Personalized content recommendation: superior resources from Baidu and third parties, big data algorism recommendations and deep-learning technologies.

Face Recognition Abilities

Face scanning boarding, personalized configuration, bioassay security, facial payment.

Industry-leading image recognition superiority, up to 99.77% facial recognition rate, connects account, payment, and personalization as one of integrated services.

Functions & Superiorities:

1. Face recognition scenario: supports day/night login, non-network identification, and bioassay;

2. Personalized facial login: handless Face-ID for automatic face-scanning login, enjoying personalized services from system: active greetings, automatic seat adjustment, synchronization for entertaining contents and map information;

3. Facial payment: non-obstacle in-car payment: purchase movie tickets by voice commands after facial scanning boarding, finish closed-circle of in-car payment.

Six key abilities:

1. Face scanning: scans, tracks faces and gathers facial information

2. Key dots positioning: positioning for 72 precise key dots on the face and five sense organs

3. Facial attributes analysis: analysis for age, gender and emotion, etc.

4. Bioassay: detects user identification

5. Face matching (1: 1): distinguishes whether two faces are the same person

6. Face search (1: N): searches similar faces in assigned face assemblage

Fatigue driving monitoring abilities

Detect, notify and take over.

Based on image deep learning technology and face recognition technology, it merges vehicle operating status and out-car environment perception to provide drivers with multi-mode solutions for driving security monitoring.

Technical Superiorities:

1. Fatigue recognition models: world first face recognition technology approved by FDDB;

2. Machine self-adaptive learning ability & prediction ability: helps to solve human body individual varieties such as thin, fat and skin colors;

3. Complex-environment adaptive ability: HD infrared camera satisfies detection and scanning of fatigue features in complex environments;

4. Flexible match & high scalability: completely cover API of driver’s image features, provide stable and easy-to-use SDK compatible with connection demands of various ends.

AR Navigation abilities

Virtual and realistic, immersive navigation.

R&D based on driving navigation engine, integrated with AR, image process, map navigation to provide real scenario AR navigation.

Technical Superiorities:

1. World-leading AR navigation ability, makes virtual reality and virtuality together, and improves driving safety as well;

2. Industry-leading road absorption, sensor data smoothing, road matching, AR road planning abilities;

3. Cutting-edge lane change TD-PSOLA, makes reality and virtuality together to improve driving security, provides car owners with a professional experience and a personalized AR interaction experience;

4. More intuitive, more precise and timelier compared with conventional navigations.

Human · vehicle · home connective abilities

Remote car control, infotainment interconnection, non-cellphone car-to-home call.

Remote car control at home, sync user preferences and resume contents anytime and anywhere.

Functions & Superiorities:

1. The world’s first in-depth V2H (vehicle to home): realizes car controls by smart home appliance including: light, outlet, air purifier, heater and so on 20 devices;

2. Remote car control by home appliance: abilities including car warming, AC switch-on, oil check, battery check, light control, window control, etc.;

3. Industry-first sound and video call realizes the mutual-interaction between screened soundbox and car;

4. Contents playing and resuming: play unfinished in-car audios on loudspeakers at home.

Security abilities

cyber security brings customers and manufacturers new challenges. Apollo provides multi-layer security to safeguard drivers.

Multi-layer protections for safe driving, solid and reliable security solutions, security upgrade kits, intrusion detecting system + vehicular firewall, vehicular black box.

Functions & Superiorities:

1. Intrusion detection and prevention system (IDPS)

Safeguards the infotainment and telematics systems of vehicles by detecting system legitimacy, prevents malicious or unauthorized software installation, and also detects suspicious connections and attempted private data breaches.

2. Car FireWall

On-vehicle firewalls monitor all network communications, while detecting and preventing abnormal network behaviors and non-credible vehicle operating instructions from causing cyber security issues.

3. Secure OTA kits

Provides OTA updates securely and reliably while allowing only authorized and protected cloud data to reach the vehicle.

4. Black box

Apollo Black Box for Intelligent Vehicles is a product suite that includes both hardware and software.

1). Safe Storage Hardware

It can be easily integrated with intelligent vehicles to provide safe storage of large data sets through data compression, encryption processing and rapid transmission.

2). Data Reader Software

The data can be decrypted and read with a user-friendly interface. Through this, the data can be easily accessed to trace the root causes of events and improve product quality.