Mon Aug 17, 2020 6:23 am
Hello,
[b]
CAMERA MCAM400 NOT WORK ON NANOPI MAV2 UNDER BUILDROOT IMAGE [/b]
We have made lot of tests, for try to understand the problem with Rockchip MIPI camera fail on Nanopi m4v2.
We have used two configurations with the same hardware : Nanopi m4v2 + MCAM400 camera module (OV4689)
Configuration 1 : your image "rk3399-sd-friendlycore-bionic-4.4-arm64-20200623.img" is flashed on a SD card
MCAM400 Camera module is OKAY, your tool "gst-camera.sh" is running without problems, we can take photos and video streams.
Configuration 2 : your image "rk3399-sd-buildroot-linux-4.4-arm64-20200623.img" is flashed on a SD card.
Camera do not work, your tool "gst-camera.sh" fail with errors, we cannot take photo or video streams.
May be, there is some differences in the kernel use in these versions (drivers differences, kernel configuration, ....) ?
May be, there is some differences in the rockchip gstreamer plugin version ?
Following you can see differencies that we have detect, in the kernel start traces, and in the gst-camaera.sh command line.
Please we need help to find solution for use camera under buildroot version
We are waiting for your support
Best Ragards
HANSEN Franck
---------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------
CONFIGURATION 1 WITH IMAGE 3rk3399-sd-friendlycore-bionic-4.4-arm64-20200623.img" --> MCAM400 CAMERA MODURE IS RUNNING
Starting kernel ...
[ 0.000000] Booting Linux on physical CPU 0x0
....
....
[b][ 0.000000] Linux version 4.4.179 (root@jensen) (gcc version 6.4.0 (ctng-1.23.0-150g-FA) ) #1 SMP Tue Mar 17 16:51:26 CST 2020[/b]
....
....
[ 1.607261] ov4689 1-0036: driver version: 00.01.01
[ 1.607669] fusb302 4-0022: CC connected in CC1 as UFP
[ 1.608180] ov4689 1-0036: could not get module information!
[ 1.609170] 1-0036 supply avdd not found, using dummy regulator
[ 1.609808] 1-0036 supply dovdd not found, using dummy regulator
[ 1.610413] 1-0036 supply dvdd not found, using dummy regulator
[ 1.613440] ov4689 1-0036: Detected OV004688 sensor
[ 1.614216] ov4689 2-0036: driver version: 00.01.01
[ 1.614659] ov4689 2-0036: could not get module information!
[ 1.615566] 2-0036 supply avdd not found, using dummy regulator
[ 1.616168] 2-0036 supply dovdd not found, using dummy regulator
[ 1.616777] 2-0036 supply dvdd not found, using dummy regulator
[ 1.619527] ov4689 2-0036: Unexpected sensor id(000000), ret(-5)
....
....
[ 2.096746] rkisp1 ff910000.rkisp1: rkisp1 driver version: v00.01.04
[ 2.097345] rkisp1 ff910000.rkisp1: Missing rockchip,grf property
[ 2.102672] rkisp1: Async subdev notifier completed
[ 2.103878] rkisp1 ff920000.rkisp1: rkisp1 driver version: v00.01.04
[ 2.104467] rkisp1 ff920000.rkisp1: Missing rockchip,grf property
[ 2.107602] mmc2: queuing unknown CIS tuple 0x80 (2 bytes)
[ 2.109684] mmc2: queuing unknown CIS tuple 0x80 (3 bytes)
[ 2.111748] mmc2: queuing unknown CIS tuple 0x80 (3 bytes)
[ 2.115057] mmc2: queuing unknown CIS tuple 0x80 (7 bytes)
[ 2.133489] rkisp1 ff910000.rkisp1: clear unready subdev num: 0
[ 2.134067] rkisp1 ff920000.rkisp1: clear unready subdev num: 2
[b][ 2.135792] rockchip-mipi-dphy-rx: No link between dphy and sensor
[ 2.137013] rockchip-mipi-dphy-rx: No link between dphy and sensor
[ 2.137565] rkisp1: update sensor failed[/b]
....
....
Ubuntu 18.04.2 LTS NanoPi-M4v2 ttyFIQ0
NanoPi-M4v2 login: root
Password:
Last login: Mon Jun 25 07:13:04 UTC 2018 on ttyFIQ0
_____ _ _ _ _____ _ _____ ____
| ___| __(_) ___ _ __ __| | |_ _| ____| | | ____/ ___|
| |_ | '__| |/ _ \ '_ \ / _` | | | | | _| | | | _|| |
| _|| | | | __/ | | | (_| | | |_| | |___| |___| |__| |___
|_| |_| |_|\___|_| |_|\__,_|_|\__, |_____|_____|_____\____|
|___/
Welcome to Ubuntu 18.04.2 LTS 4.4.179
....
....
root@NanoPi-M4v2:~# gst-camera.sh -a photo -o test10.jpg
gst-launch-1.0: no process found
====================================================
=== GStreamer 1.1 command:
=== gst-launch-1.0 rkisp num-buffers=20 device=/dev/video0 io-mode=1 ! video/x-raw,format=NV12,width=1920,height=1080,framerate=10/1 ! jpegenc ! multifilesink location="/tmp/isp-frame%d.jpg"
====================================================
{{{{{{ start take photo
Setting pipeline to PAUSED ...
media get entity by name: lens is null
[b]XCAM ERROR v4l2_device.cpp:254: VIDIOC_QUERYCAP returned: -1 (Inappropriate ioctl for device)
XCAM ERROR v4l2_device.cpp:254: VIDIOC_QUERYCAP returned: -1 (Inappropriate ioctl for device)
XCAM ERROR rkisp_control_loop_impl.cpp:99: failed to get camera module info[/b]
Pipeline is live and does not need PREROLL ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
XCAM ERROR rkisp_device.cpp:72: atomisp device(/dev/video0) try subdev format failed
Got EOS from element "pipeline0".
Execution ended after 0:00:00.890092292
Setting pipeline to PAUSED ...
Setting pipeline to READY ...
Setting pipeline to NULL ...
Freeing pipeline ...
}}}}}} end take photo
root@NanoPi-M4v2:~#
---------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------
CONFIGURATION 2 WITH IMAGE "rk3399-sd-buildroot-linux-4.4-arm64-20200623.img" --> MCAM400 CAMERA MODULE IS NOT WORKING
Starting kernel ...
[ 0.000000] Booting Linux on physical CPU 0x0
....
....
[b][ 0.000000] Linux version 4.4.179 (root@tzs-i7pc) (gcc version 6.3.1 20170404 (Linaro GCC 6.3-2017.05) ) #1 SMP Tue Sep 3 15:54:9[/b]
....
....
[ 1.607899] ov4689 1-0036: driver version: 00.01.01
[ 1.607911] ov4689 1-0036: could not get module information!
[ 1.608328] 1-0036 supply avdd not found, using dummy regulator
[ 1.608436] 1-0036 supply dovdd not found, using dummy regulator
[ 1.608485] 1-0036 supply dvdd not found, using dummy regulator
[ 1.611216] ov4689 1-0036: Detected OV004688 sensor
[ 1.612248] ov4689 2-0036: driver version: 00.01.01
[ 1.612709] ov4689 2-0036: could not get module information!
[ 1.613644] 2-0036 supply avdd not found, using dummy regulator
[ 1.614258] 2-0036 supply dovdd not found, using dummy regulator
[ 1.614868] 2-0036 supply dvdd not found, using dummy regulator
[ 1.617569] ov4689 2-0036: Unexpected sensor id(000000), ret(-5)
....
....
[ 2.156493] rkisp1 ff910000.rkisp1: rkisp1 driver version: v00.01.04
[ 2.157131] rkisp1 ff910000.rkisp1: Missing rockchip,grf property
[ 2.160266] rkisp1: Async subdev notifier completed
[ 2.161774] rkisp1 ff920000.rkisp1: rkisp1 driver version: v00.01.04
[ 2.162378] rkisp1 ff920000.rkisp1: Missing rockchip,grf property
[ 2.193398] rkisp1 ff910000.rkisp1: clear unready subdev num: 0
[ 2.193962] rkisp1 ff920000.rkisp1: clear unready subdev num: 2
[[b] 2.194845] rockchip-mipi-dphy-rx: No link between dphy and sensor
[ 2.195399] rkisp1 ff920000.rkisp1: failed to get fmt for rockchip-mipi-dphy-rx[/b]
....
....
Welcome to Rockchip Linux SDK
....
....
[root@rk3399:/]# gst-camera.sh -a photo -o test10.jpg
killall: gst-launch-1.0: no process killed
====================================================
=== GStreamer 1.1 command:
=== gst-launch-1.0 rkisp num-buffers=20 device=/dev/video0 io-mode=1 ! video/x-raw,format=NV12,width=1920,height=1080,framerate=10/1 ! jpegenc ! multifilesink location="/tmp/isp-frame%d.jp"
====================================================
{{{{{{ start take photo
Setting pipeline to PAUSED ...
media get entity by name: lens is null
XCAM ERROR rkisp_control_loop_impl.cpp:146: failed to get camera module info
XCAM ERROR rkisp_control_loop_impl.cpp:319: failed to get cam module info
Pipeline is live and does not need PREROLL ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
XCAM ERROR rkisp_device.cpp:72: atomisp device(/dev/video0) try subdev format failed
[b]XCAM ERROR rkisp_control_loop_impl.cpp:365: rkisp_cl_start: invalid cl state 0
ERROR: from element /GstPipeline:pipeline0/GstXCamSrc:xcamsrc0: Internal data stream error.[/b]
Additional debug info:
gstbasesrc.c(3055): gst_base_src_loop (): /GstPipeline:pipeline0/GstXCamSrc:xcamsrc0:
[b]streaming stopped, reason not-negotiated (-4)[/b]
Execution ended after 0:00:00.003464417
Setting pipeline to PAUSED ...
Setting pipeline to READY ...
Setting pipeline to NULL ...
Freeing pipeline ...
}}}}}} end take photo
[root@rk3399:/]#
---------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------
[b]
CAMERA MCAM400 NOT WORK ON NANOPI MAV2 UNDER BUILDROOT IMAGE [/b]
We have made lot of tests, for try to understand the problem with Rockchip MIPI camera fail on Nanopi m4v2.
We have used two configurations with the same hardware : Nanopi m4v2 + MCAM400 camera module (OV4689)
Configuration 1 : your image "rk3399-sd-friendlycore-bionic-4.4-arm64-20200623.img" is flashed on a SD card
MCAM400 Camera module is OKAY, your tool "gst-camera.sh" is running without problems, we can take photos and video streams.
Configuration 2 : your image "rk3399-sd-buildroot-linux-4.4-arm64-20200623.img" is flashed on a SD card.
Camera do not work, your tool "gst-camera.sh" fail with errors, we cannot take photo or video streams.
May be, there is some differences in the kernel use in these versions (drivers differences, kernel configuration, ....) ?
May be, there is some differences in the rockchip gstreamer plugin version ?
Following you can see differencies that we have detect, in the kernel start traces, and in the gst-camaera.sh command line.
Please we need help to find solution for use camera under buildroot version
We are waiting for your support
Best Ragards
HANSEN Franck
---------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------
CONFIGURATION 1 WITH IMAGE 3rk3399-sd-friendlycore-bionic-4.4-arm64-20200623.img" --> MCAM400 CAMERA MODURE IS RUNNING
Starting kernel ...
[ 0.000000] Booting Linux on physical CPU 0x0
....
....
[b][ 0.000000] Linux version 4.4.179 (root@jensen) (gcc version 6.4.0 (ctng-1.23.0-150g-FA) ) #1 SMP Tue Mar 17 16:51:26 CST 2020[/b]
....
....
[ 1.607261] ov4689 1-0036: driver version: 00.01.01
[ 1.607669] fusb302 4-0022: CC connected in CC1 as UFP
[ 1.608180] ov4689 1-0036: could not get module information!
[ 1.609170] 1-0036 supply avdd not found, using dummy regulator
[ 1.609808] 1-0036 supply dovdd not found, using dummy regulator
[ 1.610413] 1-0036 supply dvdd not found, using dummy regulator
[ 1.613440] ov4689 1-0036: Detected OV004688 sensor
[ 1.614216] ov4689 2-0036: driver version: 00.01.01
[ 1.614659] ov4689 2-0036: could not get module information!
[ 1.615566] 2-0036 supply avdd not found, using dummy regulator
[ 1.616168] 2-0036 supply dovdd not found, using dummy regulator
[ 1.616777] 2-0036 supply dvdd not found, using dummy regulator
[ 1.619527] ov4689 2-0036: Unexpected sensor id(000000), ret(-5)
....
....
[ 2.096746] rkisp1 ff910000.rkisp1: rkisp1 driver version: v00.01.04
[ 2.097345] rkisp1 ff910000.rkisp1: Missing rockchip,grf property
[ 2.102672] rkisp1: Async subdev notifier completed
[ 2.103878] rkisp1 ff920000.rkisp1: rkisp1 driver version: v00.01.04
[ 2.104467] rkisp1 ff920000.rkisp1: Missing rockchip,grf property
[ 2.107602] mmc2: queuing unknown CIS tuple 0x80 (2 bytes)
[ 2.109684] mmc2: queuing unknown CIS tuple 0x80 (3 bytes)
[ 2.111748] mmc2: queuing unknown CIS tuple 0x80 (3 bytes)
[ 2.115057] mmc2: queuing unknown CIS tuple 0x80 (7 bytes)
[ 2.133489] rkisp1 ff910000.rkisp1: clear unready subdev num: 0
[ 2.134067] rkisp1 ff920000.rkisp1: clear unready subdev num: 2
[b][ 2.135792] rockchip-mipi-dphy-rx: No link between dphy and sensor
[ 2.137013] rockchip-mipi-dphy-rx: No link between dphy and sensor
[ 2.137565] rkisp1: update sensor failed[/b]
....
....
Ubuntu 18.04.2 LTS NanoPi-M4v2 ttyFIQ0
NanoPi-M4v2 login: root
Password:
Last login: Mon Jun 25 07:13:04 UTC 2018 on ttyFIQ0
_____ _ _ _ _____ _ _____ ____
| ___| __(_) ___ _ __ __| | |_ _| ____| | | ____/ ___|
| |_ | '__| |/ _ \ '_ \ / _` | | | | | _| | | | _|| |
| _|| | | | __/ | | | (_| | | |_| | |___| |___| |__| |___
|_| |_| |_|\___|_| |_|\__,_|_|\__, |_____|_____|_____\____|
|___/
Welcome to Ubuntu 18.04.2 LTS 4.4.179
....
....
root@NanoPi-M4v2:~# gst-camera.sh -a photo -o test10.jpg
gst-launch-1.0: no process found
====================================================
=== GStreamer 1.1 command:
=== gst-launch-1.0 rkisp num-buffers=20 device=/dev/video0 io-mode=1 ! video/x-raw,format=NV12,width=1920,height=1080,framerate=10/1 ! jpegenc ! multifilesink location="/tmp/isp-frame%d.jpg"
====================================================
{{{{{{ start take photo
Setting pipeline to PAUSED ...
media get entity by name: lens is null
[b]XCAM ERROR v4l2_device.cpp:254: VIDIOC_QUERYCAP returned: -1 (Inappropriate ioctl for device)
XCAM ERROR v4l2_device.cpp:254: VIDIOC_QUERYCAP returned: -1 (Inappropriate ioctl for device)
XCAM ERROR rkisp_control_loop_impl.cpp:99: failed to get camera module info[/b]
Pipeline is live and does not need PREROLL ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
XCAM ERROR rkisp_device.cpp:72: atomisp device(/dev/video0) try subdev format failed
Got EOS from element "pipeline0".
Execution ended after 0:00:00.890092292
Setting pipeline to PAUSED ...
Setting pipeline to READY ...
Setting pipeline to NULL ...
Freeing pipeline ...
}}}}}} end take photo
root@NanoPi-M4v2:~#
---------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------
CONFIGURATION 2 WITH IMAGE "rk3399-sd-buildroot-linux-4.4-arm64-20200623.img" --> MCAM400 CAMERA MODULE IS NOT WORKING
Starting kernel ...
[ 0.000000] Booting Linux on physical CPU 0x0
....
....
[b][ 0.000000] Linux version 4.4.179 (root@tzs-i7pc) (gcc version 6.3.1 20170404 (Linaro GCC 6.3-2017.05) ) #1 SMP Tue Sep 3 15:54:9[/b]
....
....
[ 1.607899] ov4689 1-0036: driver version: 00.01.01
[ 1.607911] ov4689 1-0036: could not get module information!
[ 1.608328] 1-0036 supply avdd not found, using dummy regulator
[ 1.608436] 1-0036 supply dovdd not found, using dummy regulator
[ 1.608485] 1-0036 supply dvdd not found, using dummy regulator
[ 1.611216] ov4689 1-0036: Detected OV004688 sensor
[ 1.612248] ov4689 2-0036: driver version: 00.01.01
[ 1.612709] ov4689 2-0036: could not get module information!
[ 1.613644] 2-0036 supply avdd not found, using dummy regulator
[ 1.614258] 2-0036 supply dovdd not found, using dummy regulator
[ 1.614868] 2-0036 supply dvdd not found, using dummy regulator
[ 1.617569] ov4689 2-0036: Unexpected sensor id(000000), ret(-5)
....
....
[ 2.156493] rkisp1 ff910000.rkisp1: rkisp1 driver version: v00.01.04
[ 2.157131] rkisp1 ff910000.rkisp1: Missing rockchip,grf property
[ 2.160266] rkisp1: Async subdev notifier completed
[ 2.161774] rkisp1 ff920000.rkisp1: rkisp1 driver version: v00.01.04
[ 2.162378] rkisp1 ff920000.rkisp1: Missing rockchip,grf property
[ 2.193398] rkisp1 ff910000.rkisp1: clear unready subdev num: 0
[ 2.193962] rkisp1 ff920000.rkisp1: clear unready subdev num: 2
[[b] 2.194845] rockchip-mipi-dphy-rx: No link between dphy and sensor
[ 2.195399] rkisp1 ff920000.rkisp1: failed to get fmt for rockchip-mipi-dphy-rx[/b]
....
....
Welcome to Rockchip Linux SDK
....
....
[root@rk3399:/]# gst-camera.sh -a photo -o test10.jpg
killall: gst-launch-1.0: no process killed
====================================================
=== GStreamer 1.1 command:
=== gst-launch-1.0 rkisp num-buffers=20 device=/dev/video0 io-mode=1 ! video/x-raw,format=NV12,width=1920,height=1080,framerate=10/1 ! jpegenc ! multifilesink location="/tmp/isp-frame%d.jp"
====================================================
{{{{{{ start take photo
Setting pipeline to PAUSED ...
media get entity by name: lens is null
XCAM ERROR rkisp_control_loop_impl.cpp:146: failed to get camera module info
XCAM ERROR rkisp_control_loop_impl.cpp:319: failed to get cam module info
Pipeline is live and does not need PREROLL ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
XCAM ERROR rkisp_device.cpp:72: atomisp device(/dev/video0) try subdev format failed
[b]XCAM ERROR rkisp_control_loop_impl.cpp:365: rkisp_cl_start: invalid cl state 0
ERROR: from element /GstPipeline:pipeline0/GstXCamSrc:xcamsrc0: Internal data stream error.[/b]
Additional debug info:
gstbasesrc.c(3055): gst_base_src_loop (): /GstPipeline:pipeline0/GstXCamSrc:xcamsrc0:
[b]streaming stopped, reason not-negotiated (-4)[/b]
Execution ended after 0:00:00.003464417
Setting pipeline to PAUSED ...
Setting pipeline to READY ...
Setting pipeline to NULL ...
Freeing pipeline ...
}}}}}} end take photo
[root@rk3399:/]#
---------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------