Linux Developer Community Cameras



Stream RICOH THETA V or Z1 cameras with small Linux board computers such as NVIDIA Jetson Nano or x86. UVC 1.5 open source driver and gstreamer sample app. Control camera API and power it with a USB cable.

You will be registered in the theta360.guide community.
Why Is My Registration Required?

Sony’s Camera Remote API beta SDK allows you to control a number of Sony cameras, including Sony Action cams, Sony Alpha cameras and Lens Style cameras, wirelessly from another device. This opens up for a number of exciting use cases, such as zoom control, remote viewfinder, self-timer settings, still image capture and recording start and stop. Blackmagic Design capture and playback products work with some of the world’s best software via the freely available Desktop Video SDK. This makes it incredibly easy to create your own custom solutions for one-off projects or for commercial products you will sell. The Lepton® SDK is a development package for creating hardware / software solutions based on the Lepton thermal imager. Learn More We’re building more than innovative technologies; we’re striving to create a more sustainable, more efficient, and safer future by enhancing human perception through best-in-class intelligent imaging & sensing. With Visual Studio 2019 you can build and debug C projects on a remote Linux system or the Windows Subsystem for Linux (WSL). You can get started with Linux development in Visual Studio using MSBuild-based Linux projects or our native support for CMake. CMake lets you use the same source code and build scripts to target multiple platforms.

Integrate Live Streaming with the USB API

Switch Between Still Image and Live Streaming Modes

Wake Camera From Sleep

Run OpenCV and TensorFlow

Use OpenCV and TensorFlow to detect objects and trigger applications

Huge Storage

Save 4K video to the storage of the Linux board computer

Custom Video Pipeline

Build your own video processing pipeline to broadcast stream to other cloud services.

Open Source and Open APIs

Open source user mode Linux driver and open APIs allow you to freely build future-proof applications.

“New Linux video USB driver support allows developers to control RICOH THETA streaming video through the USB API. Please check out our sample programs that show developers how to process video to detect objects in real-time.”

Community Developer

theta360.guide

Based on libuvc by Ken Tossell.

Modifications for RICOH THETA cameras by nickel110

Understand your options

You can either use the NVIDIA proprietary video driver for x86 Linux, currently version 450 as of Oct 16, 2020, or use the X.org nouveau driver. Learn the differences and how the driver can impact your gstreamer application, which is needed to access the RICOH THETA camera on /dev/video0 or /dev/video1. Performance of both drivers is good. Latency is below 1 second. The NVIDIA proprietary driver may be a bit lower latency. Try it yourself.

Mounting Options

The bottom screw of the THETA is 1/4' by 20 threads per inch. This is a standard tripod screw size. You need to use an extender to fit the USB cable to the send of the female connector on the camera.

When you mount the camera, you can either use a light stand with a narrow mounting base or you can use a triod and an extender. The extender on the right is made from a 1/4' by 20tpi stud and coupler from a hardware store. The extender cost about USD $3 in parts. You still need to buy a tripod with this rig. An AmazonBasics Alumninum light stand is USD $20.49.

Test Streaming Concepts

Learn by doing. Have fun testing concepts such as RTSP streaming and use cheap robots to help you and your colleagues imagine new ways of seeing and processing live streaming visual data.

Although .guide is an independent site, we receive sponsorship from RICOH. In order to justify the value of this site to our sponsor, we report back to RICOH on popularity metrics for different types of content. .guide does not sell anything and there are no paid ads or endorsements on our sites. We succeed if the content we provide is of use to people.

There is little public documentation on the ricohapi GitHub READMEs and web sites about Linux Live Streaming. We are slowly collecting tests from the community and augmenting community tests with our own tests. The process takes time. There are still many gaps in the Linux Streaming documentation and it will take more time to solve these problems. Registration helps us verify the value of our work with the community. Thank you.

If you ever find information on this site that is useful, please let us know or let someone at RICOH know. The effort by you will help all of us to continue the exchange of community content.

  • 2Raspberry Pi HQ camera
  • 3Raspberry Pi HQ camera IMX477 Linux driver for NVIDIA®Jetson Xavier™ NX
    • 3.1Download JetPack
  • 4Installing the Driver - Option A: Debian Packages (Recommended)
    • 4.2Installing the debian packages
  • 5Installing the Driver - Option B: JetPack sources patch
    • 5.3Patch instructions
    • 5.4Kernel build instructions
    • 5.5Flash the Jetson
  • 7Supported Features
  • 8Example Pipelines
    • 8.1Display
    • 8.2MP4 Recording
    • 8.3JPEG snapshots

Problems running the pipelines shown on this page?
Please see our GStreamer Debugging guide for help.

Introduction to Raspberry Pi HQ camera Sony IMX477 Linux driver

RidgeRun is actively working to enable customers with great software solutions on top of powerful hardware. For this reason, RidgeRun is currently working to create the V4L2 driver for the Raspberry Pi HQ camera. This wiki contains a brief introduction to the sensor and hardware that will be used to develop the driver. Please keep in mind that the driver can be ported to other Jetson platforms if needed. Please contact us if you require more information.

Raspberry Pi HQ camera


Camera Features

  • 12.3-Megapixel high-resolution Sony IMX477 sensor.
  • 1.55μm × 1.55μm Pixel Size – double the pixel area of IMX219 for improved low-light performance.
  • Back-illuminated sensor architecture for improved sensitivity.
  • Support for different C- and CS-mount lenses.
  • Integrated back-focus adjustment ring and tripod mount.

Sony IMX477 Basic Drive Mode

The Raspberry Pi HQ camera uses the IMX477 CMOS sensor of Sony to capture. Such a sensor provides the modes included in the table below. At this point RidgeRun is working to support one mode only but others can be added per request.

Drive ModeNumber of active pixelsMaximum frame rate
[frame/s]
Output InterfaceADC
[bit]
Full (4:3) (Normal)4056 x 3040
approx. 12.33 M pixels
60CSI-210
40CSI-212
Full (4:3) (DOL-HDR)4056 x 3040
approx. 12.33 M pixels
DOL 2 frame:30
DOL 3 frame:15
CSI-210
Full (16:9) 4K2K (Normal)4056 x 2288
approx. 9.28 M pixels
79CSI-210
Full (16:9) 4K2K (DOL-HDR)4056 x 2288
approx. 9.28 M pixels
DOL 2 frame:39
DOL 3 frame:19
CSI-210
Full (4:3) Binning (Normal)2028 x 1520
approx. 3.08 M pixels
179CSI-210
Full (16:9) Binning 1080P (Normal)2028 x 1128
approx. 2.29 M pixels
240CSI-210
Full (16:9) Binning 720P (Normal)1348 x 750
approx. 1.01 M pixels
240CSI-210
Full (16:9) Scaling 1080P (Normal)2024 x 1142
approx. 2.31 M pixels
79CSI-210
Full (16:9) Scalling 720P (Normal)1348 x 762
approx. 1.03 M pixels
79CSI-210

Compatibility with NVIDIA®Jetson™ Platforms

The Raspberry Pi HQ camera module requires a hardware modification in order to work with Jetson Platforms.Both Jetson Nano and Jetson Xavier NX provides 1.8V for reset GPIO in the camera interface, but the camera module requires 3.3V.

To fix this issue a resistor labeled as R8 must be removed from the camera module. If you decide to apply this fix it is under your own risk. RidgeRun is not responsible for any damage caused to your board. The following picture shows the location of the R8 in the module.

Figure 1. R8 resistor on RPi HQ camera module.

Raspberry Pi HQ camera IMX477 Linux driver for NVIDIA®Jetson Xavier™ NX

RidgeRun Engineering has developed the driver with NVIDIA Corporation and Leopard Imaging Inc. as a collaborative initiative.In this section, you will find the instructions to patch the JetPack sources enabling the IMX477 sensor driver for the Jetson Xavier NX. These instructions have been validated in the following Jetpack versions:

  • Jetpack 4.4
  • Jetpack 4.4.1
  • Jetpack 4.5

Download JetPack

The current version of the driver is supported in Jetpack 4.4, 4.4.1 and 4.5. Porting the driver to other versions and platforms is possible.

1. Download and install the NVIDIA SDK Manager (membership is required).

2. Put your NVIDIA membership credentials in the SDK Manager main window:

Figure 2. Required SDK Manager credentials.

3. Select JetPack version and Jetson [Xavier NX | Nano] as shown below and press Continue:

Figure 3. Required SDK Manager options.

4. Accept the terms and conditions and press Continue. The SDK Manager will download and install the selected components:

Figure 4. SDK Manager download and install software.

5. Select Manual Setup. Make sure the board is in Recovery Mode and then press Flash:

Figure 5. Manual setup to start the flashing process.

Recovery Mode for Jetson NX

  • NOTE: To set the Xavier NX developer kit in Recovery Mode the following steps are required:
  1. Ensure the device is powered off and the power adapter is disconnected.
  2. Verify that a microSD Card is inserted in the Jetson Xavier NX module's card slot.
  3. Place a jumper across the Force Recovery Mode pins (9 and 10) on the button header [J14]. Please, see Figure 6 below.
  4. Connect your host computer to the developer kit's USB Micro-B connector.
  5. Connect the power supply to the power jack [J16]. The developer kit automatically powers on in Force Recovery Mode.
  6. Remove the jumper from the Force Recovery Mode pins.
  7. Use the lsusb command to check if the NVidia corp message is shown.


Figure 6. Jumper between pins 9 and 10 to get the board on Recovery Mode (top view).

6. When the OS has been installed successfully in the [Xavier NX | Nano], you will be asked to enter the board IP, a username and a password, as shown below in Figure7:

Figure 7. Required username and password for your profile in the board.

7. Don't close the window of Figure 7 and don't modify its content yet. Yo need to connect a screen to the board via HDMI, a keyboard/mouse via USB port, and a network cable via Ethernet port. You can remove the jumper that keeps the board in Recovery Mode and then reboot the Xavier board at this point if necessary.

8. After reboot, you will be asked to accept the 'terms of the license' in the board's screen. Select the checkbox and press Continue.

9. Select your language in the next screen and press Continue:

Figure 8. Language selection.

10. Select your keyboard layout and press Continue:

Figure 9. Keyboard layout selection.

11. Select your location and press Continue:

Figure 10. Location selection.

12. Enter a username and a password. Then, press Continue:

Figure 11. User credentials for Ubuntu.

13. Wait for the system to apply the changes. The board will restart automatically.

14. Now you are able to access Ubuntu as a new user in the [Xavier NX | Nano]. You can find the board IP by using ifconfig from a terminal.

15. Get back to the window presented in Figure 7 (in your host PC) and enter the IP, username, and password which the [Xavier NX | Nano] has been configured with. Then press Install.

Figure 12. User credentials to start the software installation process.

16. The software installation process should finish successfully, as shown in Figure 13:

Figure 13. Finishing software install.
  • IMPORTANT: From now on we will refer as $JETPACK_DIR/ to the directory where the SDK Manager placed the JetPack_4.4_Linux_JETSON_[PLATFORM]_DEVKIT / JetPack_4.4.1_Linux_JETSON_[PLATFORM]_DEVKIT / JetPack_4.5_Linux_JETSON_[PLATFORM]_DEVKIT folder.

Gigabyte Port Devices driver. Where [PLATFORM] must be replaced by XAVIER_NX or NANO.


Installing the Driver - Option A: Debian Packages (Recommended)

This is the simplest way to install the IMX477 driver on Jetson platforms.

Downloading the debian packages

You can download the Debian packages according to your platform from the following link:

Installing the debian packages

Jetson Xavier NX

  • Copy the kernel and dtb debian packages to your board filesystem:
  • Install the debian packages in your board:
  • Enable the dtb changes by modifying the /boot/extlinux/extlinux.conf file:
  • Reboot your board:

Jetson Nano

  • Copy the kernel and dtb debian packages to your board filesystem:
  • Install the debian packages in your board:
  • Enable the dtb changes by modifying the /boot/extlinux/extlinux.conf file:
  • Reboot your board:
  • After these steps, the driver should be working and you can run some capture tests described below.
  • IMPORTANT: You may see some washed-out colors in the captured image. This is because you haven't applied the ISP configuration file. Make sure to install the ISP file that you can find in the repo using these instructions.

Installing the Driver - Option B: JetPack sources patch

Getting the kernel patch

RidgeRun has created a repository from where you can download the patch files with the following structure:

Older versions can be found in jetpack-4.4 and jetpack-4.4.1 branches in the repository. You just have to switch to the jetpack version branch you want to use

Download the JetPack sources

The sources can be downloaded from the NVIDIA's Download Center:

Jetpack 4.4

Jetpack 4.4.1

Jetpack 4.5

1. You must be able to download a file called public_sources.tbz2.

2. Untar the sources

3. Move the hardware/ and kernel/ folders into Linux_for_Tegra/ inside the JetPack directory $JETPACK_DIR/:

Where [PLATFORM] must be replaced by XAVIER_NX or NANO, and [JETPACK_VERSION] must be replaced by 4.4, 4.4.1 or 4.5.

Patch instructions

Download the patches

  • Check out an older branch in case you want to test an older Jetpack version.

Where [PLATFORM] must be replaced by nx or nano.

Apply the patches

Kernel build instructions

Once the sources have been patched, perform the following steps in order to build and install the driver.

Install the Toolchain

NVIDIA recommends using the Linaro 7.3.1 2018.05 toolchain. Download the pre-built toolchain binaries as follows:

Execute the following commands to extract the toolchain:

Build the kernel

  • Create the main directories:
  • Establish the building paths:
  • Configure and build kernel:
  • Select:

Press the Y key in order to select the IMX477 option.Go back by hitting the double Esc key until you get the message: Do you want to save your new configuration?, select Yes and press Enter.

  • Compile kernel, device tree and modules:

Flash the Jetson

Linux Developer Community Cameras Software

Flash the Xavier NX

Please, make sure the board is in Recovery Mode.

Linux Developer Community Cameras App

  • Copy the generated kernel and dtb:
  • Flash the dtb:
  • Copy the kernel image:
  • Move the Image from /tmp to /boot inside the Xavier NX's filesystem:

Flash the Nano

  • Make sure your extlinux.conf file at /boot/extlinux/extlinux.conf in your Nano's filesystem looks as follows:
  • Copy the kernel image and DTB:
  • Move the files from /tmp to /boot inside the Nano's filesystem:

Copy the kernel modules

  • You can also just access your SD card in your PC and copy the KERNEL_MODULES=$JETPACK_DIR/JetPack_[JETPACK_VERSION]_Linux_JETSON_[PLATFORM]_DEVKIT/Linux_for_Tegra/modules/lib/modules/4.9.140/* directory content into /lib/modules/4.9.140/ in your SD card to update the modules. Where [PLATFORM] must be replaced by XAVIER_NX or NANO, and [JETPACK_VERSION] must be replaced by 4.4, 4.4.1 or 4.5.
  • Or you can update with your compiled modules If your board is up you can update the kernel modules as follows:

Where [PLATFORM] must be replaced by XAVIER_NX or NANO, and [JETPACK_VERSION] must be replaced by 4.4, 4.4.1 or 4.5.

The Discovery hasn't been tested by either of the leading safety agencies here in the U.S., but Land Rover offers a full suite of driver-assistance features. A handful of features are standard but. Install Drivers for STMicroelectronics Discovery Boards Before you start working on Support Package for STMicroelectronics ® Discovery™ boards, you must first configure your computer to detect the STMicroelectronics Discovery board. To detect the Support Package for STMicroelectronics Discovery board. Additional Driver Discovery (A.D.D.) identifies potential additional drivers in a household. There are many reasons why there are drivers in a household who may not have been disclosed by the applicant. Reports these drivers, as well as the identity information associated with them. Discovery driver care.

  • Move the modules from /tmp to the /lib/modules/ folder inside the Jetson's filesystem and reboot:
  • After these steps, the driver should be working and you can run some capture tests described below.
  • IMPORTANT: You may see some washed-out colors in the captured image. This is because you haven't applied the ISP configuration file. Make sure to install the ISP file that you can find in the repo using these instructions.

ISP camera overrides installation

Please, visit the Custom ISP Configuration page in order to learn how to use the camera_overrides.isp file to configure the ISP.

OCM have been Reconditioning, Recycling and Reselling Laptops for the Last 25 Years, giving you great products at unbelievable prices. Cofiman laptops & desktops driver download for windows 10 64-bit. LaptopsAnytime is “shaking up” the Public Access Computing Market by taking self-service laptop/tablet lending, loans, checkout and borrowing to the next level. No longer do facilities have to settle for incomplete solutions (desktops, mobile carts, lockers and manual programs). Note: All station designs and software platform are proprietary.

Supported Features

Resolutions and framerates

  • 1920x1080 @ 60fps
  • 4032x3040 @ 30fps

Controls

  • Gain
  • Exposure
  • Framerate
  • Group Hold

Example Pipelines

Find some example pipelines to use the IMX477 on Jetson Xavier NX below:

Linux Developer Community Cameras Wireless

Display

Linux Developer Community Cameras Best Buy

1920x1080

4032x3040

MP4 Recording

1920x1080

4032x3040

JPEG snapshots

1920x1080

4032x3040

Contact Us

Cameras
Visit our Main Website for the RidgeRun Products and Online Store. RidgeRun Engineering informations are available in RidgeRun Professional Services and RidgeRun Subscription Model pages. Please email to support@ridgerun.com for technical questions. Contact details for sponsoring the RidgeRun GStreamer projects are available at the Sponsor Projects page.
Retrieved from 'http://developer.ridgerun.com/wiki/index.php?title=Raspberry_Pi_HQ_camera_IMX477_Linux_driver_for_Jetson&oldid=34128'