Stream RICOH THETA V or Z1 cameras with small Linux board computers such as NVIDIA Jetson Nano or x86. UVC 1.5 open source driver and gstreamer sample app. Control camera API and power it with a USB cable.
- Linux Developer Community Cameras Software
- Linux Developer Community Cameras App
- Linux Developer Community Cameras Wireless
- Linux Developer Community Cameras Best Buy
Why Is My Registration Required?
Sony’s Camera Remote API beta SDK allows you to control a number of Sony cameras, including Sony Action cams, Sony Alpha cameras and Lens Style cameras, wirelessly from another device. This opens up for a number of exciting use cases, such as zoom control, remote viewfinder, self-timer settings, still image capture and recording start and stop. Blackmagic Design capture and playback products work with some of the world’s best software via the freely available Desktop Video SDK. This makes it incredibly easy to create your own custom solutions for one-off projects or for commercial products you will sell. The Lepton® SDK is a development package for creating hardware / software solutions based on the Lepton thermal imager. Learn More We’re building more than innovative technologies; we’re striving to create a more sustainable, more efficient, and safer future by enhancing human perception through best-in-class intelligent imaging & sensing. With Visual Studio 2019 you can build and debug C projects on a remote Linux system or the Windows Subsystem for Linux (WSL). You can get started with Linux development in Visual Studio using MSBuild-based Linux projects or our native support for CMake. CMake lets you use the same source code and build scripts to target multiple platforms.
Integrate Live Streaming with the USB API
Switch Between Still Image and Live Streaming Modes
Wake Camera From Sleep
Run OpenCV and TensorFlow
Use OpenCV and TensorFlow to detect objects and trigger applications
Huge Storage
Save 4K video to the storage of the Linux board computer
Custom Video Pipeline
Build your own video processing pipeline to broadcast stream to other cloud services.
Open Source and Open APIs
Open source user mode Linux driver and open APIs allow you to freely build future-proof applications.
“New Linux video USB driver support allows developers to control RICOH THETA streaming video through the USB API. Please check out our sample programs that show developers how to process video to detect objects in real-time.”
Community Developer
theta360.guideBased on libuvc by Ken Tossell.
Modifications for RICOH THETA cameras by nickel110
Understand your options
You can either use the NVIDIA proprietary video driver for x86 Linux, currently version 450 as of Oct 16, 2020, or use the X.org nouveau driver. Learn the differences and how the driver can impact your gstreamer application, which is needed to access the RICOH THETA camera on /dev/video0 or /dev/video1. Performance of both drivers is good. Latency is below 1 second. The NVIDIA proprietary driver may be a bit lower latency. Try it yourself.Mounting Options
The bottom screw of the THETA is 1/4' by 20 threads per inch. This is a standard tripod screw size. You need to use an extender to fit the USB cable to the send of the female connector on the camera.
When you mount the camera, you can either use a light stand with a narrow mounting base or you can use a triod and an extender. The extender on the right is made from a 1/4' by 20tpi stud and coupler from a hardware store. The extender cost about USD $3 in parts. You still need to buy a tripod with this rig. An AmazonBasics Alumninum light stand is USD $20.49.
Test Streaming Concepts
Learn by doing. Have fun testing concepts such as RTSP streaming and use cheap robots to help you and your colleagues imagine new ways of seeing and processing live streaming visual data.
Although .guide is an independent site, we receive sponsorship from RICOH. In order to justify the value of this site to our sponsor, we report back to RICOH on popularity metrics for different types of content. .guide does not sell anything and there are no paid ads or endorsements on our sites. We succeed if the content we provide is of use to people.
There is little public documentation on the ricohapi GitHub READMEs and web sites about Linux Live Streaming. We are slowly collecting tests from the community and augmenting community tests with our own tests. The process takes time. There are still many gaps in the Linux Streaming documentation and it will take more time to solve these problems. Registration helps us verify the value of our work with the community. Thank you.
If you ever find information on this site that is useful, please let us know or let someone at RICOH know. The effort by you will help all of us to continue the exchange of community content.
|
|
Introduction to Raspberry Pi HQ camera Sony IMX477 Linux driver
RidgeRun is actively working to enable customers with great software solutions on top of powerful hardware. For this reason, RidgeRun is currently working to create the V4L2 driver for the Raspberry Pi HQ camera. This wiki contains a brief introduction to the sensor and hardware that will be used to develop the driver. Please keep in mind that the driver can be ported to other Jetson platforms if needed. Please contact us if you require more information.
Raspberry Pi HQ camera
Camera Features
- 12.3-Megapixel high-resolution Sony IMX477 sensor.
- 1.55μm × 1.55μm Pixel Size – double the pixel area of IMX219 for improved low-light performance.
- Back-illuminated sensor architecture for improved sensitivity.
- Support for different C- and CS-mount lenses.
- Integrated back-focus adjustment ring and tripod mount.
Sony IMX477 Basic Drive Mode
The Raspberry Pi HQ camera uses the IMX477 CMOS sensor of Sony to capture. Such a sensor provides the modes included in the table below. At this point RidgeRun is working to support one mode only but others can be added per request.
Drive Mode | Number of active pixels | Maximum frame rate [frame/s] | Output Interface | ADC [bit] |
---|---|---|---|---|
Full (4:3) (Normal) | 4056 x 3040 approx. 12.33 M pixels | 60 | CSI-2 | 10 |
40 | CSI-2 | 12 | ||
Full (4:3) (DOL-HDR) | 4056 x 3040 approx. 12.33 M pixels | DOL 2 frame:30 DOL 3 frame:15 | CSI-2 | 10 |
Full (16:9) 4K2K (Normal) | 4056 x 2288 approx. 9.28 M pixels | 79 | CSI-2 | 10 |
Full (16:9) 4K2K (DOL-HDR) | 4056 x 2288 approx. 9.28 M pixels | DOL 2 frame:39 DOL 3 frame:19 | CSI-2 | 10 |
Full (4:3) Binning (Normal) | 2028 x 1520 approx. 3.08 M pixels | 179 | CSI-2 | 10 |
Full (16:9) Binning 1080P (Normal) | 2028 x 1128 approx. 2.29 M pixels | 240 | CSI-2 | 10 |
Full (16:9) Binning 720P (Normal) | 1348 x 750 approx. 1.01 M pixels | 240 | CSI-2 | 10 |
Full (16:9) Scaling 1080P (Normal) | 2024 x 1142 approx. 2.31 M pixels | 79 | CSI-2 | 10 |
Full (16:9) Scalling 720P (Normal) | 1348 x 762 approx. 1.03 M pixels | 79 | CSI-2 | 10 |
Compatibility with NVIDIA®Jetson™ Platforms
The Raspberry Pi HQ camera module requires a hardware modification in order to work with Jetson Platforms.Both Jetson Nano and Jetson Xavier NX provides 1.8V for reset GPIO in the camera interface, but the camera module requires 3.3V.
To fix this issue a resistor labeled as R8 must be removed from the camera module. If you decide to apply this fix it is under your own risk. RidgeRun is not responsible for any damage caused to your board. The following picture shows the location of the R8 in the module.
Raspberry Pi HQ camera IMX477 Linux driver for NVIDIA®Jetson Xavier™ NX
RidgeRun Engineering has developed the driver with NVIDIA Corporation and Leopard Imaging Inc. as a collaborative initiative.In this section, you will find the instructions to patch the JetPack sources enabling the IMX477 sensor driver for the Jetson Xavier NX. These instructions have been validated in the following Jetpack versions:
- Jetpack 4.4
- Jetpack 4.4.1
- Jetpack 4.5
Download JetPack
The current version of the driver is supported in Jetpack 4.4, 4.4.1 and 4.5. Porting the driver to other versions and platforms is possible.
1. Download and install the NVIDIA SDK Manager (membership is required).
2. Put your NVIDIA membership credentials in the SDK Manager main window:
3. Select JetPack version and Jetson [Xavier NX | Nano] as shown below and press Continue:
4. Accept the terms and conditions and press Continue. The SDK Manager will download and install the selected components:
5. Select Manual Setup. Make sure the board is in Recovery Mode and then press Flash:
Recovery Mode for Jetson NX
- NOTE: To set the Xavier NX developer kit in Recovery Mode the following steps are required:
- Ensure the device is powered off and the power adapter is disconnected.
- Verify that a microSD Card is inserted in the Jetson Xavier NX module's card slot.
- Place a jumper across the Force Recovery Mode pins (9 and 10) on the button header [J14]. Please, see Figure 6 below.
- Connect your host computer to the developer kit's USB Micro-B connector.
- Connect the power supply to the power jack [J16]. The developer kit automatically powers on in Force Recovery Mode.
- Remove the jumper from the Force Recovery Mode pins.
- Use the
lsusb
command to check if theNVidia corp
message is shown.
6. When the OS has been installed successfully in the [Xavier NX | Nano], you will be asked to enter the board IP, a username and a password, as shown below in Figure7:
7. Don't close the window of Figure 7 and don't modify its content yet. Yo need to connect a screen to the board via HDMI, a keyboard/mouse via USB port, and a network cable via Ethernet port. You can remove the jumper that keeps the board in Recovery Mode and then reboot the Xavier board at this point if necessary.
8. After reboot, you will be asked to accept the 'terms of the license' in the board's screen. Select the checkbox and press Continue.
9. Select your language in the next screen and press Continue:
10. Select your keyboard layout and press Continue:
11. Select your location and press Continue:
12. Enter a username and a password. Then, press Continue:
13. Wait for the system to apply the changes. The board will restart automatically.
14. Now you are able to access Ubuntu as a new user in the [Xavier NX | Nano]. You can find the board IP by using ifconfig
from a terminal.
15. Get back to the window presented in Figure 7 (in your host PC) and enter the IP, username, and password which the [Xavier NX | Nano] has been configured with. Then press Install.
16. The software installation process should finish successfully, as shown in Figure 13:
- IMPORTANT: From now on we will refer as
$JETPACK_DIR/
to the directory where the SDK Manager placed theJetPack_4.4_Linux_JETSON_[PLATFORM]_DEVKIT
/JetPack_4.4.1_Linux_JETSON_[PLATFORM]_DEVKIT
/JetPack_4.5_Linux_JETSON_[PLATFORM]_DEVKIT
folder.
Gigabyte Port Devices driver. Where [PLATFORM]
must be replaced by XAVIER_NX
or NANO
.
Installing the Driver - Option A: Debian Packages (Recommended)
This is the simplest way to install the IMX477 driver on Jetson platforms.
Downloading the debian packages
You can download the Debian packages according to your platform from the following link:
Installing the debian packages
Jetson Xavier NX
- Copy the kernel and dtb debian packages to your board filesystem:
- Install the debian packages in your board:
- Enable the dtb changes by modifying the
/boot/extlinux/extlinux.conf
file:
- Reboot your board:
Jetson Nano
- Copy the kernel and dtb debian packages to your board filesystem:
- Install the debian packages in your board:
- Enable the dtb changes by modifying the
/boot/extlinux/extlinux.conf
file:
- Reboot your board:
- After these steps, the driver should be working and you can run some capture tests described below.
- IMPORTANT: You may see some washed-out colors in the captured image. This is because you haven't applied the ISP configuration file. Make sure to install the ISP file that you can find in the repo using these instructions.
Installing the Driver - Option B: JetPack sources patch
Getting the kernel patch
RidgeRun has created a repository from where you can download the patch files with the following structure:
Older versions can be found in jetpack-4.4 and jetpack-4.4.1 branches in the repository. You just have to switch to the jetpack version branch you want to use
Download the JetPack sources
The sources can be downloaded from the NVIDIA's Download Center:
Jetpack 4.4
Jetpack 4.4.1
Jetpack 4.5
1. You must be able to download a file called public_sources.tbz2
.
2. Untar the sources
3. Move the hardware/
and kernel/
folders into Linux_for_Tegra/
inside the JetPack directory $JETPACK_DIR/
:
Where [PLATFORM]
must be replaced by XAVIER_NX
or NANO
, and [JETPACK_VERSION]
must be replaced by 4.4
, 4.4.1
or 4.5
.
Patch instructions
Download the patches
- Check out an older branch in case you want to test an older Jetpack version.
Where [PLATFORM]
must be replaced by nx
or nano
.
Apply the patches
Kernel build instructions
Once the sources have been patched, perform the following steps in order to build and install the driver.
Install the Toolchain
NVIDIA recommends using the Linaro 7.3.1 2018.05 toolchain. Download the pre-built toolchain binaries as follows:
Execute the following commands to extract the toolchain:
Build the kernel
- Create the main directories:
- Establish the building paths:
- Configure and build kernel:
- Select:
Press the Y key in order to select the IMX477 option.Go back by hitting the double Esc key until you get the message: Do you want to save your new configuration?, select Yes and press Enter.
- Compile kernel, device tree and modules:
Flash the Jetson
Linux Developer Community Cameras Software
Flash the Xavier NX
Please, make sure the board is in Recovery Mode.
Linux Developer Community Cameras App
- Copy the generated kernel and dtb:
- Flash the dtb:
- Copy the kernel image:
- Move the Image from
/tmp
to/boot
inside the Xavier NX's filesystem:
Flash the Nano
- Make sure your extlinux.conf file at /boot/extlinux/extlinux.conf in your Nano's filesystem looks as follows:
- Copy the kernel image and DTB:
- Move the files from
/tmp
to/boot
inside the Nano's filesystem:
Copy the kernel modules
- You can also just access your SD card in your PC and copy the KERNEL_MODULES=$JETPACK_DIR/JetPack_[JETPACK_VERSION]_Linux_JETSON_[PLATFORM]_DEVKIT/Linux_for_Tegra/modules/lib/modules/4.9.140/* directory content into /lib/modules/4.9.140/ in your SD card to update the modules. Where
[PLATFORM]
must be replaced byXAVIER_NX
orNANO
, and[JETPACK_VERSION]
must be replaced by4.4
,4.4.1
or4.5
.
- Or you can update with your compiled modules If your board is up you can update the kernel modules as follows:
Where [PLATFORM]
must be replaced by XAVIER_NX
or NANO
, and [JETPACK_VERSION]
must be replaced by 4.4
, 4.4.1
or 4.5
.
The Discovery hasn't been tested by either of the leading safety agencies here in the U.S., but Land Rover offers a full suite of driver-assistance features. A handful of features are standard but. Install Drivers for STMicroelectronics Discovery Boards Before you start working on Support Package for STMicroelectronics ® Discovery™ boards, you must first configure your computer to detect the STMicroelectronics Discovery board. To detect the Support Package for STMicroelectronics Discovery board. Additional Driver Discovery (A.D.D.) identifies potential additional drivers in a household. There are many reasons why there are drivers in a household who may not have been disclosed by the applicant. Reports these drivers, as well as the identity information associated with them. Discovery driver care.
- Move the modules from
/tmp
to the/lib/modules/
folder inside the Jetson's filesystem and reboot:
- After these steps, the driver should be working and you can run some capture tests described below.
- IMPORTANT: You may see some washed-out colors in the captured image. This is because you haven't applied the ISP configuration file. Make sure to install the ISP file that you can find in the repo using these instructions.
ISP camera overrides installation
Please, visit the Custom ISP Configuration page in order to learn how to use the camera_overrides.isp
file to configure the ISP.
OCM have been Reconditioning, Recycling and Reselling Laptops for the Last 25 Years, giving you great products at unbelievable prices. Cofiman laptops & desktops driver download for windows 10 64-bit. LaptopsAnytime is “shaking up” the Public Access Computing Market by taking self-service laptop/tablet lending, loans, checkout and borrowing to the next level. No longer do facilities have to settle for incomplete solutions (desktops, mobile carts, lockers and manual programs). Note: All station designs and software platform are proprietary.
Supported Features
Resolutions and framerates
- 1920x1080 @ 60fps
- 4032x3040 @ 30fps
Controls
- Gain
- Exposure
- Framerate
- Group Hold
Example Pipelines
Find some example pipelines to use the IMX477 on Jetson Xavier NX below:
Linux Developer Community Cameras Wireless
Display
Linux Developer Community Cameras Best Buy
1920x1080
4032x3040
MP4 Recording
1920x1080
4032x3040
JPEG snapshots
1920x1080
4032x3040
Contact Us
Visit our Main Website for the RidgeRun Products and Online Store. RidgeRun Engineering informations are available in RidgeRun Professional Services and RidgeRun Subscription Model pages. Please email to support@ridgerun.com for technical questions. Contact details for sponsoring the RidgeRun GStreamer projects are available at the Sponsor Projects page. |