devbox
一键难忘520
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

RK3568平台（camera篇）安卓hal3适配usb camera_androidhal添加对usb camera的支持

作者：一键难忘520 | 2024-07-03 21:02:15

赞

踩

androidhal添加对usb camera的支持

一.RK安卓hal3 camera框架

Camera hal3 在 android 框架中所处的位置如上图， 对上，主要实现 Framework 一整套 API 接口，响应其 控制命令，返回数据与控制参数结果。 对下， 主要是通 V4l2 框架实现与 kernel 的交互。3a 控制则是通 control loop 接口与 camera_engine_isp 交互。 另外，其中一些组件或功能的实现也会调用到其他一些第三方 库， 如 cameraBuffer 相关，会调用到 Galloc 相关库， jpeg 编码则会调用到 Hwjpeg 相关库。

二.Camera hal3 与 Frame work 交互时序 

三.usbcamera调试

首先硬件给usb供电，供电后插上usbcamera可以看到新生成的pid vid。

ls /dev/video*

新生成了video1 video2.

media-ctl -d /dev/media0 -p
  1. 1|console:/ # media-ctl -d /dev/media0 -p
  2. Opening media device /dev/media0
  3. Enumerating entities
  4. Found 4 entities
  5. Enumerating pads and links
  6. Media controller API version 0.0.189
  7.  
  8. Media device information
  9. ------------------------
  10. driver          uvcvideo
  11. model           USB2.0 PC CAMERA: USB2.0 PC CAM
  12. serial
  13. bus info        usb-fc880000.usb-1.3
  14. hw revision     0x100
  15. driver version  0.0.189
  16.  
  17. Device topology
  18. - entity 1: USB2.0 PC CAMERA: USB2.0 PC CAM (1 pad, 1 link)
  19.             type Node subtype V4L
  20.             device node name /dev/video1
  21.         pad0: Sink
  22.                 <- "Processing 2":1 [ENABLED,IMMUTABLE]
  23.  
  24. - entity 4: USB2.0 PC CAMERA: USB2.0 PC CAM (0 pad, 0 link)
  25.             type Node subtype V4L
  26.             device node name /dev/video2
  27.  
  28. - entity 8: Processing 2 (2 pads, 2 links)
  29.             type V4L2 subdev subtype Unknown
  30.         pad0: Sink
  31. v4l2_subdev_open: Failed to open subdev device node
  32.                 <- "Input 1":0 [ENABLED,IMMUTABLE]
  33.         pad1: Source
  34. v4l2_subdev_open: Failed to open subdev device node
  35.                 -> "USB2.0 PC CAMERA: USB2.0 PC CAM":0 [ENABLED,IMMUTABLE]
  36.  
  37. - entity 11: Input 1 (1 pad, 1 link)
  38.              type V4L2 subdev subtype Sensor
  39.         pad0: Source
  40. v4l2_subdev_open: Failed to open subdev device node
  41.                 -> "Processing 2":0 [ENABLED,IMMUTABLE]

 查看拓扑图，生成新的video1 video2.

dumpsys media.camera
  1. onsole:/ # dumpsys media.camera
  2.  
  3. == Service global info: ==
  4.  
  5. Number of camera devices: 1
  6. Number of normal camera devices: 1
  7. Number of public camera devices visible to API1: 1
  8.     Device 0 maps to "101"
  9. Active Camera Clients:
  10. []
  11. Allowed user IDs: 0
  12.  
  13. == Camera service events log (most recent at top): ==
  14.   02-01 18:52:22 : ADD device 101, reason: (Device added)
  15.   02-01 18:50:29 : REMOVE device 101, reason: (Device status changed from 1 to 0)
  16.   02-01 18:08:37 : DISCONNECT device 101 client for package com.android.camera2 (PID 6195)
  17.   02-01 18:08:37 : CONNECT device 101 client for package com.android.camera2 (PID 6195)
  18.   02-01 18:06:25 : ADD device 101, reason: (Device added)
  19.   02-01 18:06:16 : REMOVE device 101, reason: (Device status changed from 1 to 0)
  20.   02-01 18:03:23 : ADD device 101, reason: (Device added)
  21.   02-01 18:01:26 : REMOVE device 101, reason: (Device status changed from 1 to 0)
  22.   02-01 18:00:53 : DISCONNECT device 101 client for package com.android.camera2 (PID 4701)
  23.   02-01 18:00:53 : CONNECT device 101 client for package com.android.camera2 (PID 4701)
  24.   02-01 18:00:34 : DISCONNECT device 101 client for package com.android.camera2 (PID 3004)
  25.   02-01 18:00:34 : CONNECT device 101 client for package com.android.camera2 (PID 3004)
  26.   02-01 18:00:29 : DISCONNECT device 101 client for package com.android.camera2 (PID 3004)
  27.   02-01 18:00:29 : CONNECT device 101 client for package com.android.camera2 (PID 3004)
  28.   02-01 18:00:04 : ADD device 101, reason: (Device added)
  29.   02-01 18:00:01 : USER_SWITCH previous allowed user IDs: <None>, current allowed user IDs: 0
  30.  
  31. == Camera device 101 dynamic info: ==
  32.   Device 101 is closed, no client instance
  33. == Camera Provider HAL external/0-0 (v2.5, remote) static info: 1 devices: ==
  34. == Camera HAL device device@3.4/external/101 (v3.4) static information: ==
  35.   Resource cost: 100
  36.   Conflicting devices: None
  37.   API1 info:
  38.     Has a flash unit: false
  39.     Facing: Front
  40.     Orientation: 0
  41.   API2 camera characteristics:
  42.     Dumping camera metadata array: 55 / 55 entries, 2048 / 2048 bytes of extra data.
  43.       Version: 1, Flags: 00000000
  44.       android.info.supportedHardwareLevel (150000): byte[1]
  45.         [EXTERNAL ]
  46.       android.colorCorrection.availableAberrationModes (00004): byte[1]
  47.         [0 ]
  48.       android.control.aeAvailableAntibandingModes (10012): byte[1]
  49.         [3 ]
  50.       android.control.maxRegions (1001c): int32[3]
  51.         [0 0 0 ]
  52.       android.control.availableVideoStabilizationModes (1001a): byte[1]
  53.         [0 ]
  54.       android.control.awbAvailableModes (1001b): byte[1]
  55.         [1 ]
  56.       android.control.aeAvailableModes (10013): byte[1]
  57.         [1 ]
  58.       android.control.availableEffects (10018): byte[1]
  59.         [0 ]
  60.       android.control.availableModes (10026): byte[2]
  61.         [0 1 ]
  62.       android.edge.availableEdgeModes (30002): byte[1]
  63.         [0 ]
  64.       android.flash.info.available (50000): byte[1]
  65.         [FALSE ]
  66.       android.hotPixel.availableHotPixelModes (60001): byte[1]
  67.         [0 ]
  68.       android.jpeg.availableThumbnailSizes (70007): int32[14]
  69.         [0 0 176 144 ]
  70.         [240 144 256 144 ]
  71.         [240 160 256 154 ]
  72.         [240 180 ]
  73.       android.jpeg.maxSize (70008): int32[1]
  74.         [3145728 ]
  75.       android.lens.info.focusDistanceCalibration (90007): byte[1]
  76.         [UNCALIBRATED ]
  77.       android.lens.info.availableOpticalStabilization (90003): byte[1]
  78.         [0 ]
  79.       android.lens.facing (80005): byte[1]
  80.         [FRONT ]
  81.       android.noiseReduction.availableNoiseReductionModes (a0002): byte[1]
  82.         [0 ]
  83.       android.noiseReduction.mode (a0000): byte[1]
  84.         [OFF ]
  85.       android.request.partialResultCount (c000b): int32[1]
  86.         [1 ]
  87.       android.request.pipelineMaxDepth (c000a): byte[1]
  88.         [4 ]
  89.       android.request.maxNumOutputStreams (c0006): int32[3]
  90.         [0 2 1 ]
  91.       android.request.maxNumInputStreams (c0008): int32[1]
  92.         [0 ]
  93.       android.scaler.availableMaxDigitalZoom (d0004): float[1]
  94.         [4.00000000 ]
  95.       android.scaler.croppingType (d000d): byte[1]
  96.         [CENTER_ONLY ]
  97.       android.sensor.availableTestPatternModes (e0019): int32[2]
  98.         [0 1 ]
  99.       android.sensor.info.timestampSource (f0008): byte[1]
  100.         [UNKNOWN ]
  101.       android.sensor.orientation (e000e): int32[1]
  102.         [0 ]
  103.       android.shading.availableModes (100002): byte[1]
  104.         [0 ]
  105.       android.statistics.info.availableFaceDetectModes (120000): byte[1]
  106.         [0 ]
  107.       android.statistics.info.maxFaceCount (120002): int32[1]
  108.         [0 ]
  109.       android.statistics.info.availableHotPixelMapModes (120006): byte[1]
  110.         [0 ]
  111.       android.statistics.info.availableLensShadingMapModes (120007): byte[1]
  112.         [0 ]
  113.       android.sync.maxLatency (170001): int32[1]
  114.         [UNKNOWN ]
  115.       android.request.availableRequestKeys (c000d): int32[28]
  116.         [3 65536 65537 65538 ]
  117.         [65539 65542 65541 65543 ]
  118.         [65545 65546 65547 65549 ]
  119.         [65550 65551 65552 65553 ]
  120.         [262146 458755 458756 458757 ]
  121.         [458758 524292 655360 851968 ]
  122.         [917528 1114112 1114115 65583 ]
  123.       android.request.availableResultKeys (c000e): int32[35]
  124.         [3 65536 65537 65538 ]
  125.         [65539 65542 65567 65541 ]
  126.         [65543 65568 65545 65546 ]
  127.         [65547 65570 65549 65550 ]
  128.         [65551 65552 65553 262146 ]
  129.         [262149 458755 458756 458757 ]
  130.         [458758 524292 655360 786441 ]
  131.         [851968 917520 1114112 1114115 ]
  132.         [1114128 1114126 65583 ]
  133.       android.request.availableCharacteristicsKeys (c000f): int32[43]
  134.         [4 65554 65555 65556 ]
  135.         [65557 65558 65572 65559 ]
  136.         [65560 65574 65561 65562 ]
  137.         [65563 65573 65564 327680 ]
  138.         [1376256 458759 524293 589827 ]
  139.         [589831 655362 786444 786440 ]
  140.         [786438 786443 786442 851972 ]
  141.         [851978 851981 983040 983044 ]
  142.         [983046 983050 983048 917518 ]
  143.         [1048578 1179648 1179654 1179655 ]
  144.         [1179650 1507329 65582 ]
  145.       android.control.aeCompensationRange (10015): int32[2]
  146.         [0 0 ]
  147.       android.control.aeCompensationStep (10016): rational[1]
  148.         [(0 / 1) ]
  149.       android.control.afAvailableModes (10017): byte[2]
  150.         [1 0 ]
  151.       android.control.availableSceneModes (10019): byte[1]
  152.         [0 ]
  153.       android.control.aeLockAvailable (10024): byte[1]
  154.         [FALSE ]
  155.       android.control.awbLockAvailable (10025): byte[1]
  156.         [FALSE ]
  157.       android.scaler.availableStreamConfigurations (d000a): int32[72]
  158.         [33 160 120 OUTPUT ]
  159.         [35 160 120 OUTPUT ]
  160.         [34 160 120 OUTPUT ]
  161.         [33 176 144 OUTPUT ]
  162.         [35 176 144 OUTPUT ]
  163.         [34 176 144 OUTPUT ]
  164.         [33 320 240 OUTPUT ]
  165.         [35 320 240 OUTPUT ]
  166.         [34 320 240 OUTPUT ]
  167.         [33 352 288 OUTPUT ]
  168.         [35 352 288 OUTPUT ]
  169.         [34 352 288 OUTPUT ]
  170.         [33 640 480 OUTPUT ]
  171.         [35 640 480 OUTPUT ]
  172.         [34 640 480 OUTPUT ]
  173.         [33 800 600 OUTPUT ]
  174.         [35 800 600 OUTPUT ]
  175.         [34 800 600 OUTPUT ]
  176.       android.scaler.availableMinFrameDurations (d000b): int64[72]
  177.         [33 160 ]
  178.         [120 33333333 ]
  179.         [35 160 ]
  180.         [120 33333333 ]
  181.         [34 160 ]
  182.         [120 33333333 ]
  183.         [33 176 ]
  184.         [144 33333333 ]
  185.         [35 176 ]
  186.         [144 33333333 ]
  187.         [34 176 ]
  188.         [144 33333333 ]
  189.         [33 320 ]
  190.         [240 33333333 ]
  191.         [35 320 ]
  192.         [240 33333333 ]
  193.         [34 320 ]
  194.         [240 33333333 ]
  195.         [33 352 ]
  196.         [288 33333333 ]
  197.         [35 352 ]
  198.         [288 33333333 ]
  199.         [34 352 ]
  200.         [288 33333333 ]
  201.         [33 640 ]
  202.         [480 33333333 ]
  203.         [35 640 ]
  204.         [480 33333333 ]
  205.         [34 640 ]
  206.         [480 33333333 ]
  207.         [33 800 ]
  208.         [600 33333333 ]
  209.         [35 800 ]
  210.         [600 33333333 ]
  211.         [34 800 ]
  212.         [600 33333333 ]
  213.       android.scaler.availableStallDurations (d000c): int64[72]
  214.         [33 160 ]
  215.         [120 1000000000 ]
  216.         [35 160 ]
  217.         [120 0 ]
  218.         [34 160 ]
  219.         [120 0 ]
  220.         [33 176 ]
  221.         [144 1000000000 ]
  222.         [35 176 ]
  223.         [144 0 ]
  224.         [34 176 ]
  225.         [144 0 ]
  226.         [33 320 ]
  227.         [240 1000000000 ]

dump出来可以看到生成新的cameraid。

Number of camera devices: 1

Number of normal camera devices: 1

v4l2-ctl -d /dev/video1 --all

 查看video1信息

  1. 130|console:/ # v4l2-ctl -d /dev/video1 --all
  2. Driver Info:
  3.         Driver name      : uvcvideo
  4.         Card type        : USB2.0 PC CAMERA: USB2.0 PC CAM
  5.         Bus info         : usb-fc880000.usb-1.3
  6.         Driver version   : 5.10.189
  7.         Capabilities     : 0x84a00001
  8.                 Video Capture
  9.                 Metadata Capture
  10.                 Streaming
  11.                 Extended Pix Format
  12.                 Device Capabilities
  13.         Device Caps      : 0x04200001
  14.                 Video Capture
  15.                 Streaming
  16.                 Extended Pix Format
  17. Media Driver Info:
  18.         Driver name      : uvcvideo
  19.         Model            : USB2.0 PC CAMERA: USB2.0 PC CAM
  20.         Serial           :
  21.         Bus info         : usb-fc880000.usb-1.3
  22.         Media version    : 5.10.189
  23.         Hardware revision: 0x00000100 (256)
  24.         Driver version   : 5.10.189
  25. Interface Info:
  26.         ID               : 0x03000002
  27.         Type             : V4L Video
  28. Entity Info:
  29.         ID               : 0x00000001 (1)
  30.         Name             : USB2.0 PC CAMERA: USB2.0 PC CAM
  31.         Function         : V4L2 I/O
  32.         Pad 0x01000007   : Sink
  33.           Link 0x0200000d: from remote pad 0x100000a of entity 'Processing 2': Data, Enabled, Immutable
  34. Priority: 2
  35. Video input : 0 (Input 1: ok)
  36. Format Video Capture:
  37.         Width/Height      : 640/480
  38.         Pixel Format      : 'YUYV'
  39.         Field             : None
  40.         Bytes per Line    : 1280
  41.         Size Image        : 614400
  42.         Colorspace        : Default
  43.         Transfer Function : Default (maps to Rec. 709)
  44.         YCbCr/HSV Encoding: Default (maps to ITU-R 601)
  45.         Quantization      : Default (maps to Limited Range)
  46.         Flags             :
  47. Crop Capability Video Capture:
  48.         Bounds      : Left 0, Top 0, Width 640, Height 480
  49.         Default     : Left 0, Top 0, Width 640, Height 480
  50.         Pixel Aspect: 1/1
  51. Selection: crop_default, Left 0, Top 0, Width 640, Height 480, Flags:
  52. Selection: crop_bounds, Left 0, Top 0, Width 640, Height 480, Flags:
  53. Streaming Parameters Video Capture:
  54.         Capabilities     : timeperframe
  55.         Frames per second: 30.000 (30/1)
  56.         Read buffers     : 0
  57.                      brightness 0x00980900 (int)    : min=0 max=255 step=1 default=128 value=128
  58.                        contrast 0x00980901 (int)    : min=0 max=255 step=1 default=135 value=135
  59.                      saturation 0x00980902 (int)    : min=0 max=255 step=1 default=75 value=75
  60.                             hue 0x00980903 (int)    : min=-127 max=127 step=1 default=0 value=0
  61.                           gamma 0x00980910 (int)    : min=1 max=8 step=1 default=4 value=4
  62.            power_line_frequency 0x00980918 (menu)   : min=0 max=2 default=1 value=1
  63.                       sharpness 0x0098091b (int)    : min=0 max=15 step=1 default=5 value=5
  64.          backlight_compensation 0x0098091c (int)    : min=1 max=5 step=1 default=1 value=1
v4l2-ctl -d /dev/video1 --list-formats-ext

查看video1支持的格式和分辨率

  1. console:/ # v4l2-ctl -d /dev/video1 --list-formats-ext
  2. ioctl: VIDIOC_ENUM_FMT
  3.         Index       : 0
  4.         Type        : Video Capture
  5.         Pixel Format: 'YUYV'
  6.         Name        : YUYV 4:2:2
  7.                 Size: Discrete 640x480
  8.                         Interval: Discrete 0.033s (30.000 fps)
  9.                         Interval: Discrete 0.067s (15.000 fps)
  10.                 Size: Discrete 352x288
  11.                         Interval: Discrete 0.033s (30.000 fps)
  12.                         Interval: Discrete 0.067s (15.000 fps)
  13.                 Size: Discrete 320x240
  14.                         Interval: Discrete 0.033s (30.000 fps)
  15.                         Interval: Discrete 0.067s (15.000 fps)
  16.                 Size: Discrete 176x144
  17.                         Interval: Discrete 0.033s (30.000 fps)
  18.                         Interval: Discrete 0.067s (15.000 fps)
  19.                 Size: Discrete 160x120
  20.                         Interval: Discrete 0.033s (30.000 fps)
  21.                         Interval: Discrete 0.067s (15.000 fps)

分析：此时打开usbcamera的画面是黑屏，查看hal3 camera框架里面适配的分辨率和视频格式是否支持yuvv，最大的分辨率为640*480.

四.代码修改点亮usbcamera

  1. --- a/rk3588_an13/device/rockchip/common/external_camera_config.xml
  2. +++ b/rk3588_an13/device/rockchip/common/external_camera_config.xml
  3. @@ -7,7 +7,8 @@
  4.      <!-- See ExternalCameraUtils.cpp for default values of Device configurations below-->
  5.      <Device>
  6.          <!-- Max JPEG buffer size in bytes-->
  7. -        <MaxJpegBufferSize  bytes="3145728"/>  <!-- 3MB (~= 1080p YUV420) -->
  8. +        <!-- MaxJpegBufferSize  bytes="3145728"/> -->  <!-- 3MB (~= 1080p YUV420) -->
  9. +        <MaxJpegBufferSize  bytes="13631488"/>  <!-- 13MB 1300w pixel (~= 4k YUV420) -->
  10.          <!-- Size of v4l2 buffer queue when streaming >= 30fps -->
  11.          <!-- Larger value: more request can be cached pipeline (less janky) -->
  12.          <!-- Smaller value: use less memory -->
  1. --- a/rk3588_an13/frameworks/av/services/camera/libcameraservice/api1/client2/Parameters.h
  2. +++ b/rk3588_an13/frameworks/av/services/camera/libcameraservice/api1/client2/Parameters.h
  3. @@ -199,11 +199,11 @@ struct Parameters {
  4.      // Max preview size allowed
  5.      // This is set to a 1:1 value to allow for any aspect ratio that has
  6.      // a max long side of 1920 pixels
  7. -    static const unsigned int MAX_PREVIEW_WIDTH = 1920;
  8. -    static const unsigned int MAX_PREVIEW_HEIGHT = 1920;
  9. +    static const unsigned int MAX_PREVIEW_WIDTH = 640;
  10. +    static const unsigned int MAX_PREVIEW_HEIGHT = 480;
  11.      // Initial max preview/recording size bound
  12. -    static const int MAX_INITIAL_PREVIEW_WIDTH = 1920;
  13. -    static const int MAX_INITIAL_PREVIEW_HEIGHT = 1080;
  14. +    static const int MAX_INITIAL_PREVIEW_WIDTH = 640;
  15. +    static const int MAX_INITIAL_PREVIEW_HEIGHT = 480;
  1. --- a/rk3588_an13/hardware/interfaces/camera/device/3.4/default/ExternalCameraDevice.cpp
  2. +++ b/rk3588_an13/hardware/interfaces/camera/device/3.4/default/ExternalCameraDevice.cpp
  3. @@ -52,7 +52,7 @@ constexpr int MAX_RETRY = 5; // Allow retry v4l2 open failures a few times.
  4.  constexpr int OPEN_RETRY_SLEEP_US = 100000; // 100ms * MAX_RETRY = 0.5 seconds
  5.  
  6.  static uint Camera_Resolution[][2] = {{320,240},/*{352,288},*/
  7. -                     {640,480},{800,600},/*{1280,720},{1280,960},{1920,1080},{2048,1536},{2560,1440},{2592,1944},{2592,1456},*/
  8. +                     {640,480},/*{800,600},{1280,720},{1280,960},{1920,1080},{2048,1536},{2560,1440},{2592,1944},{2592,1456},*/
  9.                       {0,0}};
  10.  
  11.  } // anonymous namespace
  12. @@ -444,7 +444,8 @@ status_t ExternalCameraDevice::initDefaultCharsKeys(
  13.                                                    256, 144,
  14.                                                    240, 160,
  15.                                                    256, 154,
  16. -                                                  240, 180};
  17. +                                                  240, 180,
  18. +                                                  640, 480};
  19.      UPDATE(ANDROID_JPEG_AVAILABLE_THUMBNAIL_SIZES, jpegAvailableThumbnailSizes,
  20.             ARRAY_SIZE(jpegAvailableThumbnailSizes));
  1. --- a/rk3588_an13/hardware/interfaces/camera/device/3.4/default/RgaCropScale.cpp
  2. +++ b/rk3588_an13/hardware/interfaces/camera/device/3.4/default/RgaCropScale.cpp
  3. @@ -38,6 +38,11 @@ namespace camera2 {
  4.  #define RGA_ACTIVE_H (2048)
  5.  #define RGA_VIRTUAL_H (2048)
  6.  
  7. +#define RGA_ACTIVE_W (640)
  8. +#define RGA_VIRTUAL_W (640)
  9. +#define RGA_ACTIVE_H (480)
  10. +#define RGA_VIRTUAL_H (480)
  11. +
  12.  #endif

声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/w/一键难忘520/article/detail/784502
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号