Skip to content

Latest commit

 

History

History
120 lines (68 loc) · 10.9 KB

README.md

File metadata and controls

120 lines (68 loc) · 10.9 KB

DepthAI Open Source Hardware

This repository contains Luxonis open sourced baseboards, including the DepthAI OpenCV AI Kits, and contains Altium design files, documentation, and pictures. This repository is for anyone interested in developing with the DepthAI SoM or anyone interested in understaning more about the embedded hardware that powers DepthAI. An open source, community KiCad folder is also available for sharing KiCad based designs and components.

POE Designs

This board is the basis for the OAK-D-POE. And it is the equivalent of the BW1098OBC/BW1098OAK, but with POE instead of USB. So 3 onboard cameras (1x onboard IMX378 12MP autofocus color camera, 2x global shutter grayscale for stereo depth), with the stereo baseline being 7.5cm (just like BW1098OBC/BW1098OAK/OAK-D).

IMG_3045

This design is in progress. When complete it will support the DepthAI API over Ethernet, and some additional features like direct RTSP streaming.

This is the basis for OAK-1-POE. It is the equivalent of the BK1096_OAK, with with POE instead of USB. So 1x onboard IMX378 12MP autofocus color camera.

IMG_3041

This design is in progress. When complete it will support the DepthAI API over Ethernet, and some additional features like direct RTSP streaming.

The BW2098POE repository contains open hardware designed by Luxonis, and meant to be used as a baseboard for the Luxonis BW2099 DepthAI SoM. The BW2098POE baseboard offers full 802.3af, Class 3 PoE compliance with 1000BASE-T speeds, along with user-selectable external power from a 5V barrel jack. The Luxonis BW0249 12MP RGB camera module can be connected via the 26-pin FFC interface, which exposes a 4-lane MIPI CSI-2 channel directly into the Myriad X on the BW2099 module for processing. Data can also be streamed to a host via USB 3.1 Gen1 (Type-C). Finally, the BW2098POE board exposes boot selection switches, allowing the end user to boot the BW2099 module from USB or the on-board eMMC or NOR flash.

Integrated Raspberry Pi Designs

The DM1097 contains the design files for DepthAI with an integrated/onboard Raspberry Pi Compute Module 4. The DM1097 combines a host and the Luxonis DepthAI SoM to allow for fully integrated solution for real-time spatial AI. It is effectively the same as the BW1097, below, but with a Pi 4 computer module instead of a Pi 3 compute module.

image

The BW1097 repository contains open hardware designed by Luxonis, and meant to be used as a baseboard for the Luxonis BW1099 DepthAI SoM and the Raspberry Pi Compute Module 3+. Based on the Raspberry PI CMIO board, the BW1097 combines a host and the Luxonis DepthAI SoM to allow for fully integrated solution for real-time spatial AI.

Pure Embedded Design

This design showcases WiFi+BT interface and a pure-embedded usecase of DepthAI, with communication over SPI from depthai BW1099EMB to the onboard ESP32. This device can be programmed and run completely standalone with no host processor (i.e. no Linux, macOS, Windows, or RPi required).

image

It also acts as a convenient way to do AIoT - that is, using onboard AI to compress data to information to then insight. An example in a (remote) construction environment is returning a single byte from the device every couple seconds, with each bit representing if anything unsafe is happening, if there is a fire, if there is a hard-hat violation, a leak, etc.

Or conversely, driving a transducer to communicate the number of fish observed, their size, and species 1km through water, through the water as radio waves back to a fishing vessel.

USB Designs

This board is used in the depthai product known as the OpenCV AI Kit with Depth, OAK-D:

image

The BW1098OBC repository contains open hardware designed by Luxonis, and meant to be used as a baseboard for the Luxonis BW1099 DepthAI SoM. The BW1098OBC baseboard has three on-board cameras which implement stereo and RGB vision, piped directly into the DepthAI SoM for depth and AI processing. The data is then output to a host via USB 3.1 Gen1 (Type-C).

USB designs with attachable FFC camera boards

The 1090 is our updated version from the common issues customers have had with BW1098FFC. (We will keep selling the 1098FFC, for folks who have that connector type.) Improvements/changes:

  • More robust mechanical connection (a LOT more robust)
  • ESD protection added.
  • Standardized pinout (All 3 camera connectors have the same pinout - meaning that mix/match can be done using 2x 2-lane MIPI and 1x 4-lane MIPI)
  • Capability to use with ArduCam cameras w/out an adapter board (including clock sync and trigger sync).

Below is a flow-chart showing the evolution of this design over time based on customer feedback/needs.

More information about each design can be found in corresponding repositories.

The DM1090FFC repository contains open hardware designed by Luxonis, and meant to be used as a baseboard for the Luxonis BW1099 DepthAI SoM. The DM1090FFC baseboard has three FFC interfaces which allow for two DM0250TG camera modules (stereo pair) and one DM0249 RGB camera module. Besides Luxonis camera modules, several Arducam CCMs can be connected to DM1090FFC. Please note that only revision R1 and above (R1M1E1) (DM0250TG and DM0249) cameras with 26-pin FFC connectors can be connected to DM1090FFC.

The BW1094 repository contains open hardware designed by Luxonis, and meant to be used as a baseboard for the Luxonis BW1099 DepthAI SoM and as a HAT for the RPi "B" models. The BW1094 baseboard has three FFC interfaces which allow for two BG0250TG camera modules (stereo pair) and one BG0249 RGB camera module. The GPIO interface from the Raspberry Pi Model B variants is passed through the BW1094 with the exception of the 5V pins, GND pins, and BCM GPIO26 (pin 37), which is used as a way for the Raspberry Pi to reset the DepthAI SoM, parallel to the RST button.

The BK1096 repository contains open hardware designed by Luxonis, and meant to be used as a baseboard for the Luxonis BW1099 DepthAI SoM. The BK1096 baseboard offers a quick and simple way to add USB3 Type-C device power and connectivity, and a single 12MP RGB camera module to the DepthAI SoM.

Cameras and Camera Adapter Boards

The BG0249 repository contains open hardware designed by Luxonis. The BW0249 is a carrier board for the Sunny A12N02A IMX378 camera module, and is designed to be compatible with the BW1094 and BW1098FFC baseboards. A 26-pin FFC is used to carry 5V power, 4-lane MIPI, I2C, and other control signals between the BW0249 and the controller baseboards.

The BG0250TG repository contains open hardware designed by Luxonis. The BW0250TG is a carrier board for the Sunny TG161B or AN01V32 OV9282 camera module, and is designed to be compatible with the BW1094 and BW1098FFC baseboards. A 20-pin FFC is used to carry 5V power, 2-lane MIPI, I2C, and other control signals between the BW0250TG and the controller baseboards. A single BG0250TG is typically paired with another to create a stereo camera pair.

The BW0253_R0M0E0 is an adapter board to allow the Raspberry Pi HQ camera to physically interface to the DepthAI RGB camera port on the BW1098FFC.

This allows using DepthAI with all sorts of lens combinations, including variable zoom, variable focus, and even with a telescope.

image