devbox
我家小花儿
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

redroid11 集成 nvidia gpu hals_redroid audio

作者：我家小花儿 | 2024-04-16 09:37:48

赞

踩

redroid audio

前言

此篇文章中使用 nvidia 相关aosp 库、510.155_Android_R_aarch64_release文件来于原厂提供基础资料，可供 aosp 移植库基本思路。
本文记录 redroid11(aosp11) 集成 nvidia gpu 驱动库、 nvidia_omx 驱动库实践记录，以作备忘。

1>. Apply the patch to Android R code then trigger the build.

2>. Change ro.board.platform=nv-streaming for build.prop in build output, or rename the gralloc.nv-streaming.so in step #3,
corresponding to your platform name. eg: TARGET_BOARD_PLATFORM:=nv-streaming or rename gralloc.nv-streaming.so gralloc.redroid.so
在文件 @build/make/tools/buildinfo.sh 增加如下内容。

if [ -z "$TARGET_BOARD_PLATFORM" ];then
	echo "##"
	echo "## Add ro.board.platform"
	echo "##"
	echo "ro.board.platform=nv-streaming"
	#echo "ro.board.platform=AMD"
	#echo "ro.hardware.gralloc=dri"
	#echo "ro.hardware.vulkan=amd"
	#echo "ro.hardware.egl=AMD"
	echo ""
fi

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11

3>. Copy the graphics lib files in Android_aarch64_release.tar to the corresponding directory
under system/vendor/ . Remove other files under vendor/lib(64)/egl/ of your build output.

4>. Ensure hwcomposer process in the container has permission for /tmp/display_pipe.
For example, change the binderinit.sh file:
cpp chown system system /tmp chmod 777 /tmp
4.1> del umount /etc/* in binderinit.sh
cpp # umount /etc/* # rm -rf /etc # ln -s /system/etc /etc

5>. Add related property in redroid.common.rc By default the graphics will use 720p 30fps,

	setprop persist.sys.display.resolution 720x1080
	setprop persist.sys.display.refresh 30

  • 1
  • 2

6>. If you want to run container in different GPU,set below property

setprop persist.vendor.nvidia.gpu.index $index

  • 1

docker run input parament: ‘persist.vendor.nvidia.gpu.index=0/1/2…’

7>.hwcomposer2.1 which use HIDL interface
7.1> Add below part in your product manifest.xml which define hidl interface:

	<hal format="hidl">
		<name>android.hardware.graphics.composer</name>
		<transport>hwbinder</transport>
		<version>2.1</version>
		<interface>
			<name>IComposer</name>
			<instance>default</instance>
		</interface>
	</hal>
<!--nvidia begin-->
	<hal format="hidl">
		<name>vendor.nvidia.hardware.graphics.composer</name>
		<transport>hwbinder</transport>
		<version>1.0</version>
		<interface>
			<name>INvComposer</name>
			<instance>default</instance>
		</interface>
	</hal>
	<hal format="hidl">
		<name>vendor.nvidia.hardware.graphics.display</name>
		<transport>hwbinder</transport>
		<version>1.0</version>
		<interface>
			<name>INvDisplay</name>
			<instance>default</instance>
		</interface>
	</hal>
<!--nvidia end-->

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29

7.2> rewrite compatibility_matrices
${TOP}/hardware/interfaces/compatibility_matrices/compatibility_matrix.5.xml

<!--nvidia begin-->
    <hal format="hidl" optional="false">
        <name>vendor.nvidia.hardware.graphics.composer</name>
        <version>1.0</version>
        <interface>
            <name>INvComposer</name>
            <instance>default</instance>
        </interface>
    </hal>
    <hal format="hidl" optional="false">
        <name>vendor.nvidia.hardware.graphics.display</name>
        <version>1.0</version>
        <interface>
            <name>INvDisplay</name>
            <instance>default</instance>
        </interface>
    </hal>
<!--nvidia end-->

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18

7.3> 移除 android.hardware.graphics.composer@2.1-service 服务

## gpu render    
PRODUCT_PACKAGES += \
    android.hardware.drm@1.3-service-lazy.clearkey \
    android.hardware.graphics.allocator@2.0-service \
    android.hardware.graphics.allocator@2.0-impl \
    android.hardware.graphics.mapper@2.0-impl-2.1 \
    
    #android.hardware.graphics.composer@2.1-service \
    #android.hardware.graphics.composer@2.1-impl \

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9

8> graphics composer

8.1> Add vendor.nvidia.hardware.graphics.composer@1.0-service which under system\vendor\bin\hw to your image.

8.2> ensure it’s init rc vendor.nvidia.hardware.graphics.composer@1.0-service.rc and lib dependency
are included.

8.3> For internal build related reason, NVIDIA graphics lib will depend on libc++_nv_build.so
instead of libc++.so, so need copy /system/lib(64)/libc++.so to /system/lib(64)/libc++_nv_build.so for graphics lib to use.

因 510.155_Android_R_aarch64_release.tar 文件中没有 libc++_nv_build.so 库文件,从  android-arm-r.tar.gz 文件提取出 libc++_nv_build.so 并
拷贝至 redroid11 编译镜像中。

  • 1
  • 2

8.4> Need ensure libhidltransport/libhwbinder are included in container build
redroid11 手工编译 libhidl

mmm system/libhidl/
##mmm external/selinux
mmm external/libdrm
mmm system/libhwbinder

  • 1
  • 2
  • 3
  • 4

8.5>. Diff in system/linkerconfig to allow hwcomposer service load required library:

diff --git a/contents/namespace/systemdefault.cc b/contents/namespace/systemdefault.cc
index a9bfdb1..7b7c647 100644
--- a/contents/namespace/systemdefault.cc
+++ b/contents/namespace/systemdefault.cc
@@ -14,6 +14,19 @@
* limitations under the License.
*/
+// Not a contribution
+// Changes made by NVIDIA CORPORATION
+// NVIDIA-proprietary are not a contribution and subject to the following terms and conditions:
+//
+// Copyright (C) 2022 NVIDIA CORPORATION. All Rights Reserved.
+//
+// NVIDIA CORPORATION and its licensors retain all intellectual property
+// and proprietary rights in and to this software, related documentation
+// and any modifications thereto. Any use, reproduction, disclosure or
+// distribution of this software and related documentation is governed by
+// the NVIDIA Pre-Release License Agreement between NVIDIA CORPORATION and
+// the licensee. All other uses are strictly forbidden.
+
// Framework-side code runs in this namespace. Libs from /vendor partition can't
// be loaded in this namespace.
@@ -81,6 +94,8 @@ Namespace BuildSystemDefaultNamespace([[maybe_unused]] const
Context& ctx) {
"/system/vendor/framework",
"/system/vendor/app",
"/system/vendor/priv-app",
+ "/system/vendor/${LIB}/egl",
+ "/system/vendor/${LIB}/hw",
"/odm/framework",
"/odm/app",
"/odm/priv-app",
@@ -101,6 +116,10 @@ Namespace BuildSystemDefaultNamespace([[maybe_unused]] const
Context& ctx) {
ns.AddPermittedPath(product + "/${LIB}", AsanPath::SAME_PATH);
}
}
+ ns.AddPermittedPath("/system/vendor/${LIB}/egl", AsanPath::NONE);
+ ns.AddPermittedPath("/system/vendor/${LIB}/hw", AsanPath::NONE);
+ ns.AddSearchPath("/system/vendor/${LIB}/egl", AsanPath::NONE);
+ ns.AddSearchPath("/system/vendor/${LIB}/hw", AsanPath::NONE);
ns.AddRequires(std::vector{
// Keep in sync with the "platform" namespace in art/build/apex/ld.config.txt.

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43

8.6> linkerconfig 增加 libc++_nv_build.so 和 libui.so
文件中 @system/linkerconfig/contents/common/system_links.cc 增加

void AddStandardSystemLinks(const Context& ctx, Section* section) {
  const bool debuggable = android::base::GetBoolProperty("ro.debuggable", false);
  const std::string system_ns_name = ctx.GetSystemNamespaceName();
  const bool is_section_vndk_enabled = ctx.IsSectionVndkEnabled();
  section->ForEachNamespaces([&](Namespace& ns) {
    if (ns.GetName() != system_ns_name) {
      ns.GetLink(system_ns_name).AddSharedLib(kBionicLibs);
      if (!is_section_vndk_enabled || ns.GetName() != "default") {
        ns.GetLink(system_ns_name)
            .AddSharedLib(Var("SANITIZER_RUNTIME_LIBRARIES"));
      }
      if (debuggable) {
        // Library on the system image that can be dlopened for debugging purposes.
        ns.GetLink(system_ns_name).AddSharedLib("libfdtrack.so");
      }
      //>for nvidia 
      ns.GetLink(system_ns_name).AddSharedLib("libc++_nv_build.so");
      ns.GetLink(system_ns_name).AddSharedLib("libui.so");
      ns.GetLink(system_ns_name).AddSharedLib("libstagefright.so");
      //>nvidia end
    }
  });
}

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23

8.7> 修改 vendor.nvidia.hardware.graphics.composer@1.0-service.rc
封闭 composer@2.1::IComposer default 内容,解决 reference 错误。

service hwcomposer-1-0 /vendor/bin/hw/vendor.nvidia.hardware.graphics.composer@1.0-service
    class hal animation
    user system
    group graphics drmrpc
    capabilities SYS_NICE
    onrestart restart surfaceflinger
    #interface android.hardware.graphics.composer@2.1::IComposer default
    interface android.hardware.graphics.composer@2.2::IComposer default
    interface vendor.nvidia.hardware.graphics.composer@1.0::INvComposer default
    interface vendor.nvidia.hardware.graphics.display@1.0::INvDisplay default


  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11

8.8> Add media_codecs_nvidia
nvidia_omx的移植基础打打补丁文件:omx.patch.

@hardware/redroid/omx/media_codecs.xml 增加 nvidia 配置内容.

<MediaCodecs>
    <Encoders>
        <MediaCodec name="OMX.redroid.h264.encoder" type="video/avc" />
    </Encoders>

    <Include href="media_codecs_nvidia.xml" />

    <Include href="media_codecs_google_audio.xml" />
    <Include href="media_codecs_google_telephony.xml" />
    <Include href="media_codecs_google_video.xml" />
</MediaCodecs>

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11

把文件拷贝至 vendor 路径下
PRODUCT_COPY_FILES +=
vendor/nvidia/Android_R/nvidia_omx/media_codecs_nvidia.xml: ( T A R G E T C O P Y O U T V E N D O R ) / e t c / m e d i a c o d e c s n v i d i a . x m l   v e n d o r / n v i d i a / A n d r o i d R / n v i d i a o m x / l i b / l i b n v i d i a o m x . s o : (TARGET_COPY_OUT_VENDOR)/etc/media_codecs_nvidia.xml \ vendor/nvidia/Android_R/nvidia_omx/lib/libnvidia_omx.so: (TARGETC​OPYO​UTV​ENDOR)/etc/mediac​odecsn​vidia.xml vendor/nvidia/AndroidR​/nvidiao​mx/lib/libnvidiao​mx.so:(TARGET_COPY_OUT_VENDOR)/lib/libnvidia_omx.so
vendor/nvidia/Android_R/nvidia_omx/lib64/libnvidia_omx.so:$(TARGET_COPY_OUT_VENDOR)/lib64/libnvidia_omx.so \

8.9> Add libnvidia_omx.so
@framework/av/media/libstragefright/omx/OMXMaster.cpp 增加库

void OMXMaster::addVendorPlugin() {
    addPlugin("libstagefrighthw.so");
    addPlugin("libstagefrighthw_inno.so");
    addPlugin("libnvidia_omx.so");
}

  • 1
  • 2
  • 3
  • 4
  • 5

8.10> 解决 cpuset cgroup controller is not mounted! 错误

10-20 05:24:35.935     0     0 E init    : cpuset cgroup controller is not mounted!
10-20 05:24:35.936     0     0 I init    : processing action (init.svc.audioserver=running) from (/system/etc/init/audioserver.rc:35)
10-20 05:24:35.941     0     0 I init    : starting service 'vendor.audio-hal'...
10-20 05:24:35.944     0     0 E init    : cpuset cgroup controller is not mounted!

  • 1
  • 2
  • 3
  • 4

修改源码:@system/core/libprocessgroup/setup/cgroup_map_write.cpp文件内容如下:

bool CgroupSetup() {
    using namespace android::cgrouprc;

    std::map<std::string, CgroupDescriptor> descriptors;

    if (getpid() != 1) {
        LOG(ERROR) << "Cgroup setup can be done only by init process";
        //return false; 关闭 pid ！= 1 错误退出
    }

    // Make sure we do this only one time. No need for std::call_once because
    // init is a single-threaded process
    if (access(CGROUPS_RC_PATH, F_OK) == 0) {
        LOG(WARNING) << "Attempt to call SetupCgroups more than once";
        return true;
    }
    ......
}

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18

9>. Package your container image from the modified output.

测试系统集成结果

scrcpy客户端启动参数配置:
C:\NV-GPU\istream-v1.24>
start “R3” /b scrcpy.exe --tcpip=192.168.31.25:21002
–window-title=3 --window-x=640 --window-y=30 --window-width=320 --window-height=180 --always-on-top
–encoder=OMX.nvidia.h264.encoder --stay-awake -V debug
–rotation=1 --lock-video-orientation=0
–max-fps=30 --bit-rate=3000000
–codec-options=minQP:int=8,maxQP:int=35,frameCount:int=-1,isUseVBR:int=1,isSaveFile:int=0,
verbose:int=0,isSaveYuv:int=0,qp:int=25,gopSize=600,gopPreset=0,
keyPeriod=600,keyRefreshMode:int=0,keyRefreshArg:int=10,keyFrameIndex:int=-1,
isScale:int=0,scaleWith:int=1280,scaleHeight:int=720,isUseCrop:int=0,cropTopOffset:int=0,cropBottomOffset:int=0,cropLeftOffset:int=0,cropRightOffset:int=0,isUseROI=0,
roiFrameIndex=0,isUseSEI=0,seiFrameIndex=0,byPassFlages:int=255,
interval:int=60,pushStreamTimeout:int=10,bufferType:int=0,captureMode:int=5,
encoderName:string=OMX.nvidia.h264.encoder --stay-awake -V debug

声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/w/我家小花儿/article/detail/433516
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号