|
|
I have both modules working, using cuda. The python installs are not downloading. so I had to copy over python37 folder from old save 2.2.4. Wondering if that gives me all the correct packages?
Here is the partial log from the last try on install. The whole log is huge on verbose, I would be happy to send some way...
This jumps out: 2023-11-07 13:12:40: FaceProcessing: Not enough memory.
The exceptions on log access jump out also...
Any guidence?
Server version: 2.3.4-Beta
System: Windows
Operating System: Windows (Microsoft Windows 6.1.7601 Service Pack 1)
CPUs: Intel(R) Core(TM) i7-6850K CPU @ 3.60GHz (Intel)
1 CPU x 6 cores. 12 logical processors (x64)
GPU: NVIDIA GeForce RTX 3060 (12 GiB) (NVIDIA)
Driver: 474.11 CUDA: 11.4.48 (max supported: 11.4) Compute:
System RAM: 48 GiB
Target: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
.NET framework: .NET 7.0.5
Video adapter info:
NVIDIA GeForce RTX 3060:
Driver Version 30.0.14.7411
Video Processor NVIDIA GeForce RTX 3060
System GPU info:
GPU 3D Usage 3%
GPU RAM Usage 11.8 GiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168
2023-11-07 13:12:21: Preparing to install module 'FaceProcessing'
2023-11-07 13:12:21: Downloading module 'FaceProcessing'
2023-11-07 13:12:21: Preparing to install module 'FaceProcessing'
2023-11-07 13:12:21: Downloading module 'FaceProcessing'
2023-11-07 13:12:22: Installing module 'FaceProcessing'
2023-11-07 13:12:22: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2023-11-07 13:12:22: FaceProcessing: [0;33m[49m Installing CodeProject.AI Analysis Module [0m
2023-11-07 13:12:22: FaceProcessing: [0;32m[49m========================================================================[0m
2023-11-07 13:12:22: FaceProcessing: [0;32m[49m CodeProject.AI Installer [0m
2023-11-07 13:12:22: FaceProcessing: [0;32m[49m========================================================================[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49msetupMode = InstallModule[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mexecutionEnvironment = Production[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49minstallerScriptsPath = C:\Program Files\CodeProject\AI\[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49msdkScriptsDirPath = C:\Program Files\CodeProject\AI\SDK\Scripts[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mabsoluteAppRootDir = C:\Program Files\CodeProject\AI\[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mruntimesDirPath = C:\Program Files\CodeProject\AI\runtimes[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mmodulesDirPath = C:\Program Files\CodeProject\AI\modules[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mdownloadDirPath = C:\Program Files\CodeProject\AI\downloads[0m
2023-11-07 13:12:22: FaceProcessing: [0;97m[104mGeneral CodeProject.AI setup [0m
2023-11-07 13:12:22: Installing module 'FaceProcessing'
2023-11-07 13:12:22: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2023-11-07 13:12:22 [System.IO.IOException: The process cannot access the file 'C:\Program Files\CodeProject\AI\modules\FaceProcessing\install.log' because it is being used by another process.
at Microsoft.Win32.SafeHandles.SafeFileHandle.CreateFile(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode)
at System.IO.File.AppendText(String path)
at CodeProject.AI.Server.Modules.ModuleInstaller.InstallModuleAsync(String installPackagePath, String moduleId, LogVerbosity verbosity)
at CodeProject.AI.Server.Modules.ModuleInstaller.DownloadAndInstallModuleAsync(String moduleId, String version, Boolean noCache, LogVerbosity verbosity)
at CodeProject.AI.Server.Controllers.ModuleController.InstallModuleAsync(String moduleId, String version, Boolean noCache, LogVerbosity verbosity)
at lambda_method95(Closure, Object)
at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.AwaitableObjectResultExecutor.Execute(ActionContext actionContext, IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokeactionmethodasync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask`1 actionResultValueTask)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokenextactionfilterasync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokeinnerfilterasync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokefilterpipelineasync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokeasync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokeasync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Routing.EndpointMiddleware.<invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context)
at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.Http.HttpProtocol.ProcessRequests[TContext](IHttpApplication`1 application)]: Connection id "0HMUVQNTJL7FS", Request id "0HMUVQNTJL7FS:000000A1": An unhandled exception was thrown by the application.
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mCreating Directories...[0m[0;92m[49mDone[0m
2023-11-07 13:12:22: FaceProcessing: [0;97m[104mGPU support [0m
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mCUDA Present...[0m[0;33m[49mNo[0m
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mROCm Present...[0m[0;33m[49mFalse[0m
2023-11-07 13:12:22: FaceProcessing: [0;97m[104mVariable Dump [0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mmoduleName = FaceProcessing[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mmoduleVersion = 1.8.1[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mruntime = python3.7[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49minstallGPU = true[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mpythonLocation = Shared[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mpythonVersion = 3.7[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mvirtualEnvDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mvenvPythonCmdPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python.exe[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mpackagesDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages[0m
2023-11-07 13:12:22: FaceProcessing: [0;97m[104mInstalling module FaceProcessing 1.8.1 [0m
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mInstalling Python 3.7[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mInstalling python37 in C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37[0m
2023-11-07 13:12:22: FaceProcessing: [0;32m[49mPython 3.7 is already installed[0m
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mCreating Virtual Environment (Shared)...[0m[0;32m[49mVirtual Environment already present[0m
2023-11-07 13:12:23: FaceProcessing: [0;39m[49mConfirming we have Python 3.7 in our virtual environment...[0m
2023-11-07 13:12:23: FaceProcessing: [0;39m[49m-------------------------------------------------------------[0m
2023-11-07 13:12:23: FaceProcessing: [0;91m[49mError: Python not installed[0m
2023-11-07 13:12:23: FaceProcessing: [0;95m[49mDownloading models.zip to C:\Program Files\CodeProject\AI\downloads\FaceProcessing[0m
2023-11-07 13:12:23: FaceProcessing: [0;30m[49mDownloading YOLO models...[0m[0;95m[49mChecking 'C:\Program Files\CodeProject\AI\downloads\FaceProcessing\models.zip'[0m
2023-11-07 13:12:23: FaceProcessing: [0;95m[49malready exists...[0m[0;95m[49mExpanding...[0m[0;95m[49mHeading to C:\Program Files\CodeProject\AI\downloads\FaceProcessing[0m
2023-11-07 13:12:23: FaceProcessing: [0;95m[49mExtracting models.zip[0m
2023-11-07 13:12:31: FaceProcessing: [0;95m[49mTar failed - moving to PowerShell...[0m[0;32m[49mDone.[0m
2023-11-07 13:12:32: FaceProcessing: [0;39m[49mCopying contents of models.zip to assets...[0m[0;32m[49mdone[0m
2023-11-07 13:12:32: FaceProcessing: [0;39m[49mCleaning up...[0m[0;39m[49mCleaning up extracted files[0m
2023-11-07 13:12:32: FaceProcessing: [0;32m[49mdone[0m
2023-11-07 13:12:32: FaceProcessing: [0;39m[49mInstalling Python packages for FaceProcessing[0m
2023-11-07 13:12:32: FaceProcessing: [0;[49mInstalling GPU-enabled libraries: [0m[0;32m[49mIf available[0m
2023-11-07 13:12:33: FaceProcessing: [0;39m[49mEnsuring Python package manager (pip) is installed...[0mLooking in links: c:\Users\Joey\AppData\Local\Temp\tmptse0292i
2023-11-07 13:12:33: FaceProcessing: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:12:33: FaceProcessing: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:12:33: FaceProcessing: [0;32m[49mDone[0m
2023-11-07 13:12:34: FaceProcessing: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0mRequirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:12:35: FaceProcessing: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:12:36: FaceProcessing: [0;32m[49mDone[0m
2023-11-07 13:12:36: FaceProcessing: [0;95m[49mRequirements Search Path is C:\Program Files\CodeProject\AI\modules\FaceProcessing[0m
2023-11-07 13:12:36: FaceProcessing: [0;95m[49mSearching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\modules\FaceProcessing[0m
2023-11-07 13:12:36: FaceProcessing: [0;95m[49mPython packages specified by requirements.txt[0m
2023-11-07 13:12:36: FaceProcessing: [0;95m[49mChoosing Python packages from C:\Program Files\CodeProject\AI\modules\FaceProcessing\requirements.txt[0m
2023-11-07 13:12:36: FaceProcessing: Not enough memory.
2023-11-07 13:12:36: FaceProcessing: [0;39m[49mInstalling Python packages for the CodeProject.AI Server SDK[0m
2023-11-07 13:12:37: FaceProcessing: [0;39m[49mEnsuring Python package manager (pip) is installed...[0mLooking in links: c:\Users\Joey\AppData\Local\Temp\tmp399821cb
2023-11-07 13:12:37: FaceProcessing: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:12:37: FaceProcessing: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:12:37: FaceProcessing: [0;32m[49mDone[0m
2023-11-07 13:12:38: FaceProcessing: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0mRequirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:12:39: FaceProcessing: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:12:40: FaceProcessing: [0;32m[49mDone[0m
2023-11-07 13:12:40: FaceProcessing: [0;95m[49mRequirements Search Path is C:\Program Files\CodeProject\AI\SDK\Python[0m
2023-11-07 13:12:40: FaceProcessing: [0;95m[49mSearching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\SDK\Python[0m
2023-11-07 13:12:40: FaceProcessing: [0;95m[49mPython packages specified by requirements.txt[0m
2023-11-07 13:12:40: FaceProcessing: [0;95m[49mChoosing Python packages from C:\Program Files\CodeProject\AI\SDK\Python\requirements.txt[0m
2023-11-07 13:12:40: FaceProcessing: Not enough memory.
2023-11-07 13:12:40: FaceProcessing: [0;97m[42mSetup complete [0m
2023-11-07 13:12:40: Module FaceProcessing installed successfully.
2023-11-07 13:12:40: Command: C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python
2023-11-07 13:12:40:
2023-11-07 13:12:40: Attempting to start FaceProcessing with C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python "C:\Program Files\CodeProject\AI\modules\FaceProcessing\intelligencelayer\face.py"
2023-11-07 13:12:40: Starting C:\Program Files...ws\python37\venv\Scripts\python "C:\Program Files...ing\intelligencelayer\face.py"
2023-11-07 13:12:40:
2023-11-07 13:12:40: ** Module 'Face Processing' 1.8.1 (ID: FaceProcessing)
2023-11-07 13:12:40: ** Module Path: C:\Program Files\CodeProject\AI\modules\FaceProcessing
2023-11-07 13:12:40: ** AutoStart: True
2023-11-07 13:12:40: ** Queue: faceprocessing_queue
2023-11-07 13:12:40: ** Platforms: windows,linux,linux-arm64,macos,macos-arm64
2023-11-07 13:12:40: ** GPU Libraries: installed if available
2023-11-07 13:12:40: ** GPU Enabled: enabled
2023-11-07 13:12:40: ** Parallelism: 0
2023-11-07 13:12:40: ** Accelerator:
2023-11-07 13:12:40: ** Half Precis.: enable
2023-11-07 13:12:40: ** Runtime: python3.7
2023-11-07 13:12:40: ** Runtime Loc: Shared
2023-11-07 13:12:40: ** FilePath: intelligencelayer\face.py
2023-11-07 13:12:40: ** Pre installed: False
2023-11-07 13:12:40: ** Start pause: 3 sec
2023-11-07 13:12:40: ** LogVerbosity:
2023-11-07 13:12:40: ** Valid: True
2023-11-07 13:12:40: ** Environment Variables
2023-11-07 13:12:40: ** APPDIR = %CURRENT_MODULE_PATH%\intelligencelayer
2023-11-07 13:12:40: ** DATA_DIR = %DATA_DIR%
2023-11-07 13:12:40: ** MODE = MEDIUM
2023-11-07 13:12:40: ** MODELS_DIR = %CURRENT_MODULE_PATH%\assets
2023-11-07 13:12:40: ** PROFILE = desktop_gpu
2023-11-07 13:12:40: ** USE_CUDA = True
2023-11-07 13:12:40: ** YOLOv5_AUTOINSTALL = false
2023-11-07 13:12:40: ** YOLOv5_VERBOSE = false
2023-11-07 13:12:40:
2023-11-07 13:12:40: Started Face Processing module
2023-11-07 13:12:40: Installer exited with code 0
2023-11-07 13:12:43: Module FaceProcessing started successfully.
2023-11-07 13:12:44: face.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
2023-11-07 13:12:44: face.py: Vision AI services setup: Retrieving environment variables...
2023-11-07 13:12:44: face.py: USE_MPS not found. Setting to default True
2023-11-07 13:12:44: face.py: GPU in use: NVIDIA GeForce RTX 3060
2023-11-07 13:12:44: face.py: APPDIR: C:\Program Files\CodeProject\AI\modules\FaceProcessing\intelligencelayer
2023-11-07 13:12:44: face.py: PROFILE: desktop_gpu
2023-11-07 13:12:44: face.py: USE_CUDA: True
2023-11-07 13:12:44: face.py: DATA_DIR: C:\ProgramData\CodeProject\AI
2023-11-07 13:12:44: Running init for Face Processing
2023-11-07 13:12:44: face.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\FaceProcessing\assets
2023-11-07 13:12:44: face.py: MODE: MEDIUM
2023-11-07 13:12:44: Face Processing: Face Processing started. in Face Processing
2023-11-07 13:12:54: Preparing to install module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Downloading module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Preparing to install module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Downloading module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Installing module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2023-11-07 13:12:54: ObjectDetectionYolo: [0;33m[49m Installing CodeProject.AI Analysis Module [0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;32m[49m========================================================================[0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;32m[49m CodeProject.AI Installer [0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;32m[49m========================================================================[0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;37m[49msetupMode = InstallModule[0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;37m[49mexecutionEnvironment = Production[0m
2023-11-07 13:12:54: Installing module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2023-11-07 13:12:55 [System.IO.IOException: The process cannot access the file 'C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\install.log' because it is being used by another process.
at Microsoft.Win32.SafeHandles.SafeFileHandle.CreateFile(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode)
at System.IO.File.AppendText(String path)
at CodeProject.AI.Server.Modules.ModuleInstaller.InstallModuleAsync(String installPackagePath, String moduleId, LogVerbosity verbosity)
at CodeProject.AI.Server.Modules.ModuleInstaller.DownloadAndInstallModuleAsync(String moduleId, String version, Boolean noCache, LogVerbosity verbosity)
at CodeProject.AI.Server.Controllers.ModuleController.InstallModuleAsync(String moduleId, String version, Boolean noCache, LogVerbosity verbosity)
at lambda_method95(Closure, Object)
at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.AwaitableObjectResultExecutor.Execute(ActionContext actionContext, IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokeactionmethodasync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask`1 actionResultValueTask)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokenextactionfilterasync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokeinnerfilterasync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokefilterpipelineasync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokeasync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokeasync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Routing.EndpointMiddleware.<invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context)
at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.Http.HttpProtocol.ProcessRequests[TContext](IHttpApplication`1 application)]: Connection id "0HMUVQNTJL7FS", Request id "0HMUVQNTJL7FS:000000F4": An unhandled exception was thrown by the application.
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49minstallerScriptsPath = C:\Program Files\CodeProject\AI\[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49msdkScriptsDirPath = C:\Program Files\CodeProject\AI\SDK\Scripts[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49mabsoluteAppRootDir = C:\Program Files\CodeProject\AI\[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49mruntimesDirPath = C:\Program Files\CodeProject\AI\runtimes[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49mmodulesDirPath = C:\Program Files\CodeProject\AI\modules[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49mdownloadDirPath = C:\Program Files\CodeProject\AI\downloads[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;97m[104mGeneral CodeProject.AI setup [0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mCreating Directories...[0m[0;92m[49mDone[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;97m[104mGPU support [0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mCUDA Present...[0m[0;33m[49mNo[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mROCm Present...[0m[0;33m[49mFalse[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;97m[104mVariable Dump [0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mmoduleName = ObjectDetectionYolo[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mmoduleVersion = 1.7.1[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mruntime = python3.7[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49minstallGPU = true[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mpythonLocation = Shared[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mpythonVersion = 3.7[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mvirtualEnvDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mvenvPythonCmdPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python.exe[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mpackagesDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;97m[104mInstalling module ObjectDetectionYolo 1.7.1 [0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mInstalling Python 3.7[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mInstalling python37 in C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;32m[49mPython 3.7 is already installed[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mCreating Virtual Environment (Shared)...[0m[0;32m[49mVirtual Environment already present[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mConfirming we have Python 3.7 in our virtual environment...[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49m-------------------------------------------------------------[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;91m[49mError: Python not installed[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mDownloading models-yolo5-pt.zip to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;30m[49mDownloading Standard YOLO models...[0m[0;95m[49mChecking 'C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo\models-yolo5-pt.zip'[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49malready exists...[0m[0;95m[49mExpanding...[0m[0;95m[49mHeading to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mExtracting models-yolo5-pt.zip[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;95m[49mTar failed - moving to PowerShell...[0m[0;32m[49mDone.[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;39m[49mCopying contents of models-yolo5-pt.zip to assets...[0m[0;32m[49mdone[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;39m[49mCleaning up...[0m[0;39m[49mCleaning up extracted files[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;32m[49mdone[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;95m[49mDownloading custom-models-yolo5-pt.zip to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;30m[49mDownloading Custom YOLO models...[0m[0;95m[49mChecking 'C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo\custom-models-yolo5-pt.zip'[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;95m[49malready exists...[0m[0;95m[49mExpanding...[0m[0;95m[49mHeading to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;95m[49mExtracting custom-models-yolo5-pt.zip[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;95m[49mTar failed - moving to PowerShell...[0m[0;32m[49mDone.[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;39m[49mCopying contents of custom-models-yolo5-pt.zip to custom-models...[0m[0;32m[49mdone[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;39m[49mCleaning up...[0m[0;39m[49mCleaning up extracted files[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;32m[49mdone[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;39m[49mInstalling Python packages for ObjectDetectionYolo[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;[49mInstalling GPU-enabled libraries: [0m[0;32m[49mIf available[0m
2023-11-07 13:13:03: ObjectDetectionYolo: [0;39m[49mEnsuring Python package manager (pip) is installed...[0mLooking in links: c:\Users\Joey\AppData\Local\Temp\tmpvk6ykxnz
2023-11-07 13:13:03: ObjectDetectionYolo: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:13:03: ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:13:04: ObjectDetectionYolo: [0;32m[49mDone[0m
2023-11-07 13:13:04: ObjectDetectionYolo: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0mRequirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:13:06: ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:13:06: ObjectDetectionYolo: [0;32m[49mDone[0m
2023-11-07 13:13:06: ObjectDetectionYolo: [0;95m[49mRequirements Search Path is C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo[0m
2023-11-07 13:13:06: ObjectDetectionYolo: [0;95m[49mSearching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo[0m
2023-11-07 13:13:06: ObjectDetectionYolo: [0;95m[49mPython packages specified by requirements.txt[0m
2023-11-07 13:13:06: ObjectDetectionYolo: [0;95m[49mChoosing Python packages from C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\requirements.txt[0m
2023-11-07 13:13:06: ObjectDetectionYolo: Not enough memory.
2023-11-07 13:13:06: ObjectDetectionYolo: [0;39m[49mInstalling Python packages for the CodeProject.AI Server SDK[0m
2023-11-07 13:13:07: ObjectDetectionYolo: [0;39m[49mEnsuring Python package manager (pip) is installed...[0mLooking in links: c:\Users\Joey\AppData\Local\Temp\tmp36gxmpt7
2023-11-07 13:13:07: ObjectDetectionYolo: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:13:07: ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:13:08: ObjectDetectionYolo: [0;32m[49mDone[0m
2023-11-07 13:13:08: ObjectDetectionYolo: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0mRequirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:13:09: ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:13:10: ObjectDetectionYolo: [0;32m[49mDone[0m
2023-11-07 13:13:10: ObjectDetectionYolo: [0;95m[49mRequirements Search Path is C:\Program Files\CodeProject\AI\SDK\Python[0m
2023-11-07 13:13:10: ObjectDetectionYolo: [0;95m[49mSearching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\SDK\Python[0m
2023-11-07 13:13:10: ObjectDetectionYolo: [0;95m[49mPython packages specified by requirements.txt[0m
2023-11-07 13:13:10: ObjectDetectionYolo: [0;95m[49mChoosing Python packages from C:\Program Files\CodeProject\AI\SDK\Python\requirements.txt[0m
2023-11-07 13:13:10: ObjectDetectionYolo: Not enough memory.
2023-11-07 13:13:10: ObjectDetectionYolo: [0;97m[42mSetup complete [0m
2023-11-07 13:13:10: Module ObjectDetectionYolo installed successfully.
2023-11-07 13:13:10: Command: C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python
2023-11-07 13:13:10:
2023-11-07 13:13:10: Attempting to start ObjectDetectionYolo with C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect_adapter.py"
2023-11-07 13:13:10: Starting C:\Program Files...ws\python37\venv\Scripts\python "C:\Program Files...tectionYolo\detect_adapter.py"
2023-11-07 13:13:10:
2023-11-07 13:13:10: ** Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
2023-11-07 13:13:10: ** Module Path: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
2023-11-07 13:13:10: ** AutoStart: True
2023-11-07 13:13:10: ** Queue: objectdetection_queue
2023-11-07 13:13:10: ** Platforms: all
2023-11-07 13:13:10: ** GPU Libraries: installed if available
2023-11-07 13:13:10: ** GPU Enabled: enabled
2023-11-07 13:13:10: ** Parallelism: 0
2023-11-07 13:13:10: ** Accelerator:
2023-11-07 13:13:10: ** Half Precis.: enable
2023-11-07 13:13:10: ** Runtime: python3.7
2023-11-07 13:13:10: ** Runtime Loc: Shared
2023-11-07 13:13:10: ** FilePath: detect_adapter.py
2023-11-07 13:13:10: ** Pre installed: False
2023-11-07 13:13:10: ** Start pause: 1 sec
2023-11-07 13:13:10: ** LogVerbosity:
2023-11-07 13:13:10: ** Valid: True
2023-11-07 13:13:10: ** Environment Variables
2023-11-07 13:13:10: ** APPDIR = %CURRENT_MODULE_PATH%
2023-11-07 13:13:10: ** CUSTOM_MODELS_DIR = %CURRENT_MODULE_PATH%/custom-models
2023-11-07 13:13:10: ** MODELS_DIR = %CURRENT_MODULE_PATH%/assets
2023-11-07 13:13:10: ** MODEL_SIZE = Medium
2023-11-07 13:13:10: ** USE_CUDA = True
2023-11-07 13:13:10: ** YOLOv5_AUTOINSTALL = false
2023-11-07 13:13:10: ** YOLOv5_VERBOSE = false
2023-11-07 13:13:10:
2023-11-07 13:13:10: Started Object Detection (YOLOv5 6.2) module
2023-11-07 13:13:10: Installer exited with code 0
2023-11-07 13:13:11: Module ObjectDetectionYolo started successfully.
2023-11-07 13:13:15: detect_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
2023-11-07 13:13:15: detect_adapter.py: APPDIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
2023-11-07 13:13:15: detect_adapter.py: MODEL_SIZE: medium
2023-11-07 13:13:15: detect_adapter.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\assets
2023-11-07 13:13:15: Running init for Object Detection (YOLOv5 6.2)
2023-11-07 13:13:15: Object Detection (YOLOv5 6.2): Object Detection (YOLOv5 6.2) started. in Object Detection (YOLOv5 6.2)
modified 7-Nov-23 16:45pm.
|
|
|
|
|
48Gb is a fair whack of memory and shouldn't be stressed at all. I run the installed on an 8Gb raspberry Pi and a 2GB Jetson and it works (though the Jetson is creaking badly).
There are file access issues in their that are unrelated, but I wonder if the memory error is actually bogus. In image processing in .NET there is an issue where unsupported formats through a 'out of memory' error rather than a 'I don't understand this format'. I'm wondering if it's the same type of issue.
Is anything else running on your system during install?
(and if you copied the entire Python37 folder it should all be good)
cheers
Chris Maunder
|
|
|
|
|
Nothing else running, 30 gigs free. Before I had 16 gigs and a GTX 960 w/2 gigs. Two modules ran great. Of note, every install od CP.AI I have installed, just this box, has the amazon bit bucket permissions error. I can "open the doors" on this box, router too, and it will still error on permissions dowloading python and all any libraries, plus the model zips. I can make it run. It runs great. Very acceptable times.
I should add that I can go to a browser(Firefox) and download python37.zip from the bitbucket...
https:
|
|
|
|
|
I get the following error on a brand new install of 2.3.4. When I go to AI Explorer, and try to register a new face, I get "Quote: Response timeout. Try increasing the timeout value
So I started looking at the logs.
08:02:16:System: Windows
08:02:16:Operating System: Windows (Microsoft Windows 11 version 10.0.22635)
08:02:16:CPUs: AMD Ryzen Threadripper 3960X 24-Core Processor (AMD)
08:02:16: 1 CPU x 24 cores. 48 logical processors (x64)
08:02:16:GPU: NVIDIA GeForce RTX 3070 (8 GiB) (NVIDIA)
08:02:16: Driver: 546.01 CUDA: 11.8.89 (max supported: 12.3) Compute: 8.6
08:02:16:System RAM: 128 GiB
08:02:16:Target: Windows
08:02:16:BuildConfig: Release
08:02:16:Execution Env: Native
08:02:16:Runtime Env: Production
08:02:16:.NET framework: .NET 7.0.13
08:02:16:App DataDir: C:\ProgramData\CodeProject\AI
08:02:16:Video adapter info:
08:02:16: NVIDIA GeForce RTX 3070:
08:02:16: Driver Version 31.0.15.4601
08:02:16: Video Processor NVIDIA GeForce RTX 3070
08:02:16:STARTING CODEPROJECT.AI SERVER
08:02:16:RUNTIMES_PATH = C:\Program Files\CodeProject\AI\runtimes
08:02:16:PREINSTALLED_MODULES_PATH = C:\Program Files\CodeProject\AI\preinstalled-modules
08:02:16:MODULES_PATH = C:\Program Files\CodeProject\AI\modules
08:02:16:PYTHON_PATH = \bin\windows\%PYTHON_DIRECTORY%\venv\Scripts\python
08:02:16:Data Dir = C:\ProgramData\CodeProject\AI
08:02:16:Server version: 2.3.4-Beta
08:02:19:Setting up initial modules. Please be patient...
08:02:19:Installing initial module FaceProcessing.
08:02:19:Preparing to install module 'FaceProcessing'
08:02:20:Downloading module 'FaceProcessing'
08:02:21:Installing module 'FaceProcessing'
08:02:21:FaceProcessing: Installing CodeProject.AI Analysis Module
08:02:21:FaceProcessing: ========================================================================
08:02:21:FaceProcessing: CodeProject.AI Installer
08:02:21:FaceProcessing: ========================================================================
08:02:21:FaceProcessing: General CodeProject.AI setup
08:02:21:FaceProcessing: Creating Directories...Done
08:02:21:FaceProcessing: GPU support
08:02:21:FaceProcessing: CUDA Present...Yes (version 11.8)
08:02:21:FaceProcessing: ROCm Present...False
08:02:22:Server: This is the latest version
08:02:22:FaceProcessing: Installing module FaceProcessing 1.8.1
08:02:22:FaceProcessing: Installing Python 3.7
08:05:03:FaceProcessing: Downloading Python 3.7 interpreter...Expanding...Done.
08:05:16:FaceProcessing: Creating Virtual Environment (Shared)...Done
08:05:16:FaceProcessing: Confirming we have Python 3.7 in our virtual environment...present
08:22:21:Module FaceProcessing installed successfully.
08:22:21:FaceProcessing: Downloading YOLO models...
08:22:21:
08:22:21:Module 'Face Processing' 1.8.1 (ID: FaceProcessing)
08:22:21:Module Path: C:\Program Files\CodeProject\AI\modules\FaceProcessing
08:22:21:AutoStart: True
08:22:21:Queue: faceprocessing_queue
08:22:21:Platforms: windows,linux,linux-arm64,macos,macos-arm64
08:22:21:GPU Libraries: installed if available
08:22:21:GPU Enabled: enabled
08:22:21:Parallelism: 0
08:22:21:Accelerator:
08:22:21:Half Precis.: enable
08:22:21:Runtime: python3.7
08:22:21:Runtime Loc: Shared
08:22:21:FilePath: intelligencelayer\face.py
08:22:21:Pre installed: False
08:22:21:Start pause: 3 sec
08:22:21:LogVerbosity:
08:22:21:Valid: True
08:22:21:Environment Variables
08:22:21:APPDIR = %CURRENT_MODULE_PATH%\intelligencelayer
08:22:21:DATA_DIR = %DATA_DIR%
08:22:21:MODE = MEDIUM
08:22:21:MODELS_DIR = %CURRENT_MODULE_PATH%\assets
08:22:21:PROFILE = desktop_gpu
08:22:21:USE_CUDA = True
08:22:21:YOLOv5_AUTOINSTALL = false
08:22:21:YOLOv5_VERBOSE = false
08:22:21:
08:22:21:Started Face Processing module
08:22:21:Unable to install FaceProcessing: Timed out attempting to install Module 'FaceProcessing' (A task was canceled.)
08:22:21:Installing initial module ObjectDetectionNet.
08:22:21:Preparing to install module 'ObjectDetectionNet'
08:22:21:Downloading module 'ObjectDetectionNet'
08:22:21:face.py: Traceback (most recent call last):
08:22:21:face.py: File "C:\Program Files\CodeProject\AI\modules\FaceProcessing\intelligencelayer\face.py", line 21, in
08:22:21:face.py: from request_data import RequestData
08:22:21:face.py: File "../../SDK/Python\request_data.py", line 7, in
08:22:21:face.py: from PIL import Image
08:22:21:face.py: ModuleNotFoundError: No module named 'PIL'
08:22:21:face.py: has exited
08:22:21:Module FaceProcessing has shutdown
08:22:22:Installing module 'ObjectDetectionNet'
08:22:22:ObjectDetectionNet: Installing CodeProject.AI Analysis Module
08:22:22:ObjectDetectionNet: ========================================================================
08:22:22:ObjectDetectionNet: CodeProject.AI Installer
08:22:22:ObjectDetectionNet: ========================================================================
08:22:22:ObjectDetectionNet: General CodeProject.AI setup
08:22:22:ObjectDetectionNet: Creating Directories...Done
08:22:23:ObjectDetectionNet: GPU support
08:22:23:ObjectDetectionNet: CUDA Present...Yes (version 11.8)
08:22:23:ObjectDetectionNet: ROCm Present...False
08:22:23:ObjectDetectionNet: Installing module ObjectDetectionNet 1.7.1
08:22:24:Module FaceProcessing started successfully.
08:27:33:ObjectDetectionNet: Downloading ObjectDetectionNet-DirectML-1.7.1.zip...Expanding...Done.
08:27:34:ObjectDetectionNet: Copying contents of ObjectDetectionNet-DirectML-1.7.1.zip to ...done
08:27:34:ObjectDetectionNet: Cleaning up...done
08:42:22:Module ObjectDetectionNet installed successfully.
08:42:22:Module ObjectDetectionNet not configured to AutoStart.
08:42:22:ObjectDetectionNet: Downloading YOLO ONNX models...
08:42:22:Unable to install ObjectDetectionNet: Timed out attempting to install Module 'ObjectDetectionNet' (A task was canceled.)
08:42:22:Installing initial module ObjectDetectionYolo.
08:42:22:Preparing to install module 'ObjectDetectionYolo'
08:42:22:Downloading module 'ObjectDetectionYolo'
08:42:23:Installing module 'ObjectDetectionYolo'
08:42:23:ObjectDetectionYolo: Installing CodeProject.AI Analysis Module
08:42:23:ObjectDetectionYolo: ========================================================================
08:42:23:ObjectDetectionYolo: CodeProject.AI Installer
08:42:23:ObjectDetectionYolo: ========================================================================
08:42:23:ObjectDetectionYolo: General CodeProject.AI setup
08:42:24:ObjectDetectionYolo: Creating Directories...Done
08:42:24:ObjectDetectionYolo: GPU support
08:42:24:ObjectDetectionYolo: CUDA Present...Yes (version 11.8)
08:42:24:ObjectDetectionYolo: ROCm Present...False
08:42:24:ObjectDetectionYolo: Installing module ObjectDetectionYolo 1.7.1
08:42:24:ObjectDetectionYolo: Installing Python 3.7
08:42:24:ObjectDetectionYolo: Python 3.7 is already installed
08:42:24:ObjectDetectionYolo: Creating Virtual Environment (Shared)...Virtual Environment already present
08:42:24:ObjectDetectionYolo: Confirming we have Python 3.7 in our virtual environment...present
08:55:26:ObjectDetectionYolo: Downloading Standard YOLO models...Expanding...Done.
08:55:27:ObjectDetectionYolo: Copying contents of models-yolo5-pt.zip to assets...done
08:55:27:ObjectDetectionYolo: Cleaning up...done
09:02:23:Module ObjectDetectionYolo installed successfully.
09:02:23:
09:02:23:Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
09:02:23:Module Path: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
09:02:23:AutoStart: True
09:02:23:Queue: objectdetection_queue
09:02:23:Platforms: all
09:02:23:GPU Libraries: installed if available
09:02:23:GPU Enabled: enabled
09:02:23:Parallelism: 0
09:02:23:Accelerator:
09:02:23:Half Precis.: enable
09:02:23:Runtime: python3.7
09:02:23:Runtime Loc: Shared
09:02:23:FilePath: detect_adapter.py
09:02:23:Pre installed: False
09:02:23:Start pause: 1 sec
09:02:23:LogVerbosity:
09:02:23:Valid: True
09:02:23:Environment Variables
09:02:23:APPDIR = %CURRENT_MODULE_PATH%
09:02:23:CUSTOM_MODELS_DIR = %CURRENT_MODULE_PATH%/custom-models
09:02:23:MODELS_DIR = %CURRENT_MODULE_PATH%/assets
09:02:23:MODEL_SIZE = Medium
09:02:23:USE_CUDA = True
09:02:23:YOLOv5_AUTOINSTALL = false
09:02:23:YOLOv5_VERBOSE = false
09:02:23:
09:02:23:Started Object Detection (YOLOv5 6.2) module
09:02:23:ObjectDetectionYolo: Downloading Custom YOLO models...
09:02:23:Unable to install ObjectDetectionYolo: Timed out attempting to install Module 'ObjectDetectionYolo' (A task was canceled.)
09:02:23:detect_adapter.py: Traceback (most recent call last):
09:02:23:detect_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect_adapter.py", line 12, in
09:02:23:detect_adapter.py: from request_data import RequestData
09:02:23:detect_adapter.py: File "../../SDK/Python\request_data.py", line 7, in
09:02:23:detect_adapter.py: from PIL import Image
09:02:23:detect_adapter.py: ModuleNotFoundError: No module named 'PIL'
09:02:23:Module ObjectDetectionYolo has shutdown
09:02:23:detect_adapter.py: has exited
09:02:24:Module ObjectDetectionYolo started successfully.
Here is my System Tab
<blockquote class="quote"><div class="op">Quote:</div>Server version: 2.3.4-Beta
System: Windows
Operating System: Windows (Microsoft Windows 11 version 10.0.22635)
CPUs: AMD Ryzen Threadripper 3960X 24-Core Processor (AMD)
1 CPU x 24 cores. 48 logical processors (x64)
GPU: NVIDIA GeForce RTX 3070 (8 GiB) (NVIDIA)
Driver: 546.01 CUDA: 11.8.89 (max supported: 12.3) Compute: 8.6
System RAM: 128 GiB
Target: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
.NET framework: .NET 7.0.13
Video adapter info:
NVIDIA GeForce RTX 3070:
Driver Version 31.0.15.4601
Video Processor NVIDIA GeForce RTX 3070
System GPU info:
GPU 3D Usage 27%
GPU RAM Usage 3.1 GiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168</blockquote>
|
|
|
|
|
Thanks very much for the report and all that info. It could be that all you have to do is try uninstalling and reinstalling the modules you want to use, one by one.
It looks like there was also a timeout issue, though. You may need to change the ModuleInstallTimeout value in appsettings.json. You can also download the module manually: CodeProject.AI Server Modules Registry[^]
Thanks,
Sean Ewington
CodeProject
|
|
|
|
|
I noticed that if you use default model then requests will be balanced between two engines I have enabled
Object Detection (YOLOv5 6.2)
and
ObjectDetection (Coral)
Coral is usually 3-4x faster.
Yolo is faster if I use `ipcam-general` model but that one is not available for Coral so if the software is set to use custom model it will error out when it will try to get response from the Coral Engine.
- Is it possible to get the same models for Coral? I see that it is a 3th party repo on github? That way both engines can use the same custom engine.
- Is it possible to disable coral from using CPU? Sometimes (for unknown reasons for now) the TPU is not available and it will switch to CPU which is WAY slower. I would prefer for it to remain OFF then switch to CPU. In that case YoloCPU will process all object detections and it is faster the Coral CPU
- What are the cli commands to restart an engine? Sometimes a restart of Coral fixes the issue (Sometimes Face-detection also crashes and needs manual restart)
Using 2.2.4 on Docker on Linux
|
|
|
|
|
Converting YOLOv5 to edgeTPU is walked through here. A bit of fiddling and it should be straightforward enough. Unfortunately I don't have the time at the moment to dive in myself.
VavoVavo wrote: Is it possible to disable coral from using CPU
Not now, but I can add that option. The Coral module would just stop in that case.
VavoVavo wrote: What are the cli commands to restart an engine
POST: localhost:32168/v1/settings/<ModuleId>
Where moduleID is ObjectDetectionCoral for the coral module, and include a name/value pair name = 'Restart', value = 'now' in the form data sent.
cheers
Chris Maunder
|
|
|
|
|
15:46:08:ObjectDetection (Coral): Retrieved objectdetection_queue command
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...b8118a) took 2689ms
After this blurp in the log the TPU is not working, The UI still says GPU (TPU) but the numbers are > 1sec, otherwise it takes ~20ms
Probably switching to CPU
17:11:32:ObjectDetection (Coral): Retrieved objectdetection_queue command
17:11:33:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...b80a07) took 1003ms
17:11:52:ObjectDetection (Coral): Retrieved objectdetection_queue command
17:11:53:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...2532f7) took 1006ms
17:12:04:ObjectDetection (Coral): Retrieved objectdetection_queue command
17:12:05:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...020032) took 1003ms
17:12:35:ObjectDetection (Coral): Retrieved objectdetection_queue command
17:12:36:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...58423f) took 1003ms
I can detect this by periodic tests from my monitoring system by sending a detection request with a known image periodically. So I can automate the restarts or CPAI can implement service autorestart?
|
|
|
|
|
Just installed codeproject/ai-server:cuda11_7 in docker and it reports size of 10.9GB. This is plain insane. Why it needs to be that huge? I bet it can fit couple hundreds megs at max. Fix it please, it makes no sense at all.
|
|
|
|
|
Welcome to the world of AI.
The main culprits are
- PyTorch and other AI / GPU libraries. Well over a Gb each
- The AI models themselves. 10's of Mb each
- The base OS
- The NVIDIA drivers and libraries.
cheers
Chris Maunder
|
|
|
|
|
I installed 2.3.4 on my Win10 machine with Quadro P1000 but I can't get YOLOv5 6.2 - 1.7.1 to use GPU anymore. Always says CPU. I tried reinstalling CPAI and the module without cache. Logs looks like it detects CUDA and is looking to use it, but info for the module says it's running on CPU.
Previous CPAI version listed it as running on GPU.
UPDATE 1
Did a clean and re-install of latest supported drivers and CUDA 11.8 as per instructions.
Server version: 2.3.4-Beta
System: Windows
Operating System: Windows (Microsoft Windows 10.0.19045)
CPUs: Intel(R) Core(TM) i7-8700T CPU @ 2.40GHz (Intel)
1 CPU x 6 cores. 12 logical processors (x64)
GPU: Quadro P1000 (4 GiB) (NVIDIA)
Driver: 537.70 CUDA: 11.8.89 (max supported: 12.2) Compute: 6.1
System RAM: 16 GiB
Target: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
.NET framework: .NET 7.0.5
Video adapter info:
NVIDIA Quadro P1000:
Driver Version 31.0.15.3770
Video Processor Quadro P1000
Intel(R) UHD Graphics 630:
Driver Version 31.0.101.2125
Video Processor Intel(R) UHD Graphics Family
System GPU info:
GPU 3D Usage 0%
GPU RAM Usage 398 MiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168
Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
Module Path: <root>\modules\ObjectDetectionYolo
AutoStart: True
Queue: objectdetection_queue
Platforms: all
GPU Libraries: installed if available
GPU Enabled: enabled
Parallelism: 0
Accelerator:<br />
Half Precis.: enable
Runtime: python3.7
Runtime Loc: Shared
FilePath: detect_adapter.py
Pre installed: False
Start pause: 1 sec
LogVerbosity:<br />
Valid: True
Environment Variables
APPDIR = <root>\modules\ObjectDetectionYolo
CUSTOM_MODELS_DIR = <root>\modules\ObjectDetectionYolo\custom-models
MODELS_DIR = <root>\modules\ObjectDetectionYolo\assets
MODEL_SIZE = Medium
USE_CUDA = True
YOLOv5_AUTOINSTALL = false
YOLOv5_VERBOSE = false
Started: 05 nov. 2023 11:36:08 a.m. W. Europe Standard Time
LastSeen: 05 nov. 2023 11:39:07 a.m. W. Europe Standard Time
Status: Started
Processed: 0
Provider:<br />
CanUseGPU: False
HardwareType: CPU
11:34:18:Call to Uninstall on module ObjectDetectionYolo has completed.
11:35:37:Preparing to install module 'ObjectDetectionYolo'
11:35:37:Downloading module 'ObjectDetectionYolo'
11:35:38:Installing module 'ObjectDetectionYolo'
11:35:38:ObjectDetectionYolo: Installing CodeProject.AI Analysis Module<br />
11:35:38:ObjectDetectionYolo: ========================================================================
11:35:38:ObjectDetectionYolo: CodeProject.AI Installer<br />
11:35:38:ObjectDetectionYolo: ========================================================================
11:35:38:ObjectDetectionYolo: General CodeProject.AI setup<br />
11:35:38:ObjectDetectionYolo: Creating Directories...Done
11:35:38:ObjectDetectionYolo: GPU support<br />
11:35:38:ObjectDetectionYolo: CUDA Present...Yes (version 11.8)
11:35:38:ObjectDetectionYolo: ROCm Present...False
11:35:39:ObjectDetectionYolo: Installing module ObjectDetectionYolo 1.7.1<br />
11:35:39:ObjectDetectionYolo: Installing Python 3.7
11:35:39:ObjectDetectionYolo: Python 3.7 is already installed
11:35:39:ObjectDetectionYolo: Creating Virtual Environment (Shared)...Virtual Environment already present
11:35:39:ObjectDetectionYolo: Confirming we have Python 3.7 in our virtual environment...present
11:35:40:ObjectDetectionYolo: Downloading Standard YOLO models...already exists...Expanding...Done.
11:35:40:ObjectDetectionYolo: Copying contents of models-yolo5-pt.zip to assets...done
11:35:40:ObjectDetectionYolo: Cleaning up...done
11:35:41:ObjectDetectionYolo: Downloading Custom YOLO models...already exists...Expanding...Done.
11:35:41:ObjectDetectionYolo: Copying contents of custom-models-yolo5-pt.zip to custom-models...done
11:35:41:ObjectDetectionYolo: Cleaning up...done
11:35:41:ObjectDetectionYolo: Installing Python packages for ObjectDetectionYolo
11:35:41:ObjectDetectionYolo: [0;Installing GPU-enabled libraries: If available
11:35:43:ObjectDetectionYolo: Ensuring Python package manager (pip) is installed...Done
11:35:46:ObjectDetectionYolo: Ensuring Python package manager (pip) is up to date...Done
11:35:46:ObjectDetectionYolo: Python packages specified by requirements.windows.cuda.txt
11:35:48:ObjectDetectionYolo: - Installing Pandas, a data analysis / data manipulation tool...Already installed
11:35:49:ObjectDetectionYolo: - Installing CoreMLTools, for working with .mlmodel format models...Already installed
11:35:50:ObjectDetectionYolo: - Installing OpenCV, the Open source Computer Vision library...Already installed
11:35:51:ObjectDetectionYolo: - Installing Pillow, a Python Image Library...Already installed
11:35:52:ObjectDetectionYolo: - Installing SciPy, a library for mathematics, science, and engineering...Already installed
11:35:53:ObjectDetectionYolo: - Installing PyYAML, a library for reading configuration files...Already installed
11:35:54:ObjectDetectionYolo: - Installing PyTorch, an open source machine learning framework...Already installed
11:35:55:ObjectDetectionYolo: - Installing TorchVision, for working with computer vision models...Already installed
11:35:56:ObjectDetectionYolo: - Installing Ultralytics YoloV5 package for object detection in images...Already installed
11:35:58:ObjectDetectionYolo: - Installing Seaborn, a data visualization library based on matplotlib...Already installed
11:35:58:ObjectDetectionYolo: Installing Python packages for the CodeProject.AI Server SDK
11:35:59:ObjectDetectionYolo: Ensuring Python package manager (pip) is installed...Done
11:36:02:ObjectDetectionYolo: Ensuring Python package manager (pip) is up to date...Done
11:36:02:ObjectDetectionYolo: Python packages specified by requirements.txt
11:36:03:ObjectDetectionYolo: - Installing Pillow, a Python Image Library...Already installed
11:36:04:ObjectDetectionYolo: - Installing Charset normalizer...Already installed
11:36:05:ObjectDetectionYolo: - Installing aiohttp, the Async IO HTTP library...Already installed
11:36:06:ObjectDetectionYolo: - Installing aiofiles, the Async IO Files library...Already installed
11:36:07:ObjectDetectionYolo: - Installing py-cpuinfo to allow us to query CPU info...Already installed
11:36:08:ObjectDetectionYolo: - Installing Requests, the HTTP library...Already installed
11:36:08:ObjectDetectionYolo: Setup complete<br />
11:36:08:Module ObjectDetectionYolo installed successfully.
11:36:08:
11:36:08:Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
11:36:08:Module Path: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
11:36:08:AutoStart: True
11:36:08:Queue: objectdetection_queue
11:36:08:Platforms: all
11:36:08:GPU Libraries: installed if available
11:36:08:GPU Enabled: enabled
11:36:08:Parallelism: 0
11:36:08:Accelerator:
11:36:08:Half Precis.: enable
11:36:08:Runtime: python3.7
11:36:08:Runtime Loc: Shared
11:36:08:FilePath: detect_adapter.py
11:36:08:Pre installed: False
11:36:08:Start pause: 1 sec
11:36:08:LogVerbosity:
11:36:08:Valid: True
11:36:08:Environment Variables
11:36:08:APPDIR = %CURRENT_MODULE_PATH%
11:36:08:CUSTOM_MODELS_DIR = %CURRENT_MODULE_PATH%/custom-models
11:36:08:MODELS_DIR = %CURRENT_MODULE_PATH%/assets
11:36:08:MODEL_SIZE = Medium
11:36:08:USE_CUDA = True
11:36:08:YOLOv5_AUTOINSTALL = false
11:36:08:YOLOv5_VERBOSE = false
11:36:08:
11:36:08:Started Object Detection (YOLOv5 6.2) module
11:36:08:Installer exited with code 0
11:36:08:Call to Install on module ObjectDetectionYolo has completed.
modified 5-Nov-23 5:43am.
|
|
|
|
|
Do you see the folder c:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo or c:\Program Files\CodeProject\AI\preinstalled-modules\ObjectDetectionYolo or both?
If you see `c:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo does that contain \bin\windows\python3.7\venv\lib\python37\site-packages (doing this off the top of my head so folder may be slightly misspelled), and if so do you see a Torch folder, and do you see mention of torch 1.13 or torch 2.0?
It should have installed torch 1.13 (and that's what the install self check says it did) but sometimes things go weird.
Everything seems in place. Not sure why it's not reporting GPU usage. Have you tried performing a detection using the explorer to give it a kick?
cheers
Chris Maunder
|
|
|
|
|
Thank you for your reply.
I only got c:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
No bin folder inside that. The Torch folders are in C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages
Inside that folder there is torch, torch-1.13.0+cpu.dist-info and torch-1.13.1.dist-info.
Detection using explorer seems fine, but it's using CPU.
Also, what is the difference on using "Detect Objects" vs "Custom Detect" in the explorer? Custom detect is about twice as fast as Detect Objects.
modified 5-Nov-23 15:54pm.
|
|
|
|
|
Sorry, I forgot YOLO was using the shared runtime space.
Your install log says
ObjectDetectionYolo: Python packages specified by requirements.windows.cuda.txt
which would install
--find-links <a href="https://download.pytorch.org/whl/torch_stable.html">https:
torch==1.13.0+cu117 # Installing PyTorch, an open source machine learning framework
--find-links <a href="https://download.pytorch.org/whl/torch_stable.html">https:
torchvision==0.14.0+cu117 # Installing TorchVision, for working with computer vision models
and yet it's showing CPU versions installed.
Can you please let me know if there's an install.log file in modules/FaceProcessing (it shares the same virtual environment) and if so, post it here?
cheers
Chris Maunder
|
|
|
|
|
I don't have faceprocessing installed for now, so I don't have that folder.
Tried uninstalling all modules and delete the files in the download folder. Installed ObjectDetectionYolo again, but still only CPU.
2023-11-08 08:04:56: Installing CodeProject.AI Analysis Module
2023-11-08 08:04:56: ========================================================================
2023-11-08 08:04:56: CodeProject.AI Installer
2023-11-08 08:04:56: ========================================================================
2023-11-08 08:04:56: setupMode = InstallModule
2023-11-08 08:04:56: executionEnvironment = Production
2023-11-08 08:04:56: installerScriptsPath = C:\Program Files\CodeProject\AI\
2023-11-08 08:04:56: sdkScriptsDirPath = C:\Program Files\CodeProject\AI\SDK\Scripts
2023-11-08 08:04:56: absoluteAppRootDir = C:\Program Files\CodeProject\AI\
2023-11-08 08:04:56: runtimesDirPath = C:\Program Files\CodeProject\AI\runtimes
2023-11-08 08:04:56: modulesDirPath = C:\Program Files\CodeProject\AI\modules
2023-11-08 08:04:56: downloadDirPath = C:\Program Files\CodeProject\AI\downloads
2023-11-08 08:04:56: General CodeProject.AI setup
2023-11-08 08:04:56: Creating Directories...Done
2023-11-08 08:04:56: GPU support
2023-11-08 08:04:56: CUDA Present...Yes (version 11.8)
2023-11-08 08:04:57: ROCm Present...False
2023-11-08 08:04:57: Variable Dump
2023-11-08 08:04:57: moduleName = ObjectDetectionYolo
2023-11-08 08:04:57: moduleVersion = 1.7.1
2023-11-08 08:04:57: runtime = python3.7
2023-11-08 08:04:57: installGPU = true
2023-11-08 08:04:57: pythonLocation = Shared
2023-11-08 08:04:57: pythonVersion = 3.7
2023-11-08 08:04:57: virtualEnvDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv
2023-11-08 08:04:57: venvPythonCmdPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python.exe
2023-11-08 08:04:57: packagesDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages
2023-11-08 08:04:57: Installing module ObjectDetectionYolo 1.7.1
2023-11-08 08:04:57: Installing Python 3.7
2023-11-08 08:04:57: Installing python37 in C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37
2023-11-08 08:04:57: Python 3.7 is already installed
2023-11-08 08:04:57: Creating Virtual Environment (Shared)...Virtual Environment already present
2023-11-08 08:04:57: Confirming we have Python 3.7 in our virtual environment...present
2023-11-08 08:04:57: Downloading models-yolo5-pt.zip to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo
2023-11-08 08:04:57: Downloading Standard YOLO models...Checking 'C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo\models-yolo5-pt.zip'
2023-11-08 08:05:12: Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo
2023-11-08 08:05:12: Extracting models-yolo5-pt.zip
2023-11-08 08:05:13: Done.
2023-11-08 08:05:13: Copying contents of models-yolo5-pt.zip to assets...done
2023-11-08 08:05:13: Cleaning up...Cleaning up extracted files
2023-11-08 08:05:13: done
2023-11-08 08:05:13: Downloading custom-models-yolo5-pt.zip to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo
2023-11-08 08:05:13: Downloading Custom YOLO models...Checking 'C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo\custom-models-yolo5-pt.zip'
2023-11-08 08:05:34: Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo
2023-11-08 08:05:34: Extracting custom-models-yolo5-pt.zip
2023-11-08 08:05:36: Done.
2023-11-08 08:05:36: Copying contents of custom-models-yolo5-pt.zip to custom-models...done
2023-11-08 08:05:36: Cleaning up...Cleaning up extracted files
2023-11-08 08:05:36: done
2023-11-08 08:05:36: Installing Python packages for ObjectDetectionYolo
2023-11-08 08:05:36: [0;Installing GPU-enabled libraries: If available
2023-11-08 08:05:37: Ensuring Python package manager (pip) is installed...Looking in links: c:\WINDOWS\TEMP\tmpuyzgcrh2
2023-11-08 08:05:37: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-08 08:05:37: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-08 08:05:37: Done
2023-11-08 08:05:40: Ensuring Python package manager (pip) is up to date...Done
2023-11-08 08:05:40: Requirements Search Path is C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
2023-11-08 08:05:40: Searching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
2023-11-08 08:05:40: CUDA version is 11.8 (11_8 / 11)
2023-11-08 08:05:40: Python packages specified by requirements.windows.cuda.txt
2023-11-08 08:05:40: Choosing Python packages from C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\requirements.windows.cuda.txt
2023-11-08 08:05:41: - Installing Pandas, a data analysis / data manipulation tool...Already installed
2023-11-08 08:05:43: - Installing CoreMLTools, for working with .mlmodel format models...Already installed
2023-11-08 08:05:44: - Installing OpenCV, the Open source Computer Vision library...Already installed
2023-11-08 08:05:45: - Installing Pillow, a Python Image Library...Already installed
2023-11-08 08:05:46: - Installing SciPy, a library for mathematics, science, and engineering...Already installed
2023-11-08 08:05:47: - Installing PyYAML, a library for reading configuration files...Already installed
2023-11-08 08:05:48: - Installing PyTorch, an open source machine learning framework...Already installed
2023-11-08 08:05:49: - Installing TorchVision, for working with computer vision models...Already installed
2023-11-08 08:05:51: - Installing Ultralytics YoloV5 package for object detection in images...Already installed
2023-11-08 08:05:52: - Installing Seaborn, a data visualization library based on matplotlib...Already installed
2023-11-08 08:05:52: Installing Python packages for the CodeProject.AI Server SDK
2023-11-08 08:05:53: Ensuring Python package manager (pip) is installed...Looking in links: c:\WINDOWS\TEMP\tmpl2s847ef
2023-11-08 08:05:53: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-08 08:05:53: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-08 08:05:53: Done
2023-11-08 08:05:56: Ensuring Python package manager (pip) is up to date...Done
2023-11-08 08:05:56: Requirements Search Path is C:\Program Files\CodeProject\AI\SDK\Python
2023-11-08 08:05:56: Searching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\SDK\Python
2023-11-08 08:05:56: CUDA version is 11.8 (11_8 / 11)
2023-11-08 08:05:56: Python packages specified by requirements.txt
2023-11-08 08:05:56: Choosing Python packages from C:\Program Files\CodeProject\AI\SDK\Python\requirements.txt
2023-11-08 08:05:57: - Installing Pillow, a Python Image Library...Already installed
2023-11-08 08:05:58: - Installing Charset normalizer...Already installed
2023-11-08 08:05:59: - Installing aiohttp, the Async IO HTTP library...Already installed
2023-11-08 08:06:01: - Installing aiofiles, the Async IO Files library...Already installed
2023-11-08 08:06:02: - Installing py-cpuinfo to allow us to query CPU info...Already installed
2023-11-08 08:06:03: - Installing Requests, the HTTP library...Already installed
2023-11-08 08:06:03: Setup complete
Installer exited with code 0
So, are you saying that it's using the shared virtual environment that already contains the (wrong) requirements? Can I delete that and try to recreate it somehow?
|
|
|
|
|
ALPR will not work. It is installed. Not sure how to trouble shoot at this point
00:18:56:
00:18:56:Started License Plate Reader module
00:18:57:ALPR_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
00:18:57:ALPR_adapter.py: Traceback (most recent call last):
00:18:57:ALPR_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR_adapter.py", line 17, in
00:18:57:ALPR_adapter.py: from ALPR import init_detect_platenumber, detect_platenumber
00:18:57:ALPR_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR.py", line 19, in
00:18:57:ALPR_adapter.py: from paddleocr import PaddleOCR
00:18:57:ALPR_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python37\venv\lib\site-packages\paddleocr\__init__.py", line 14, in
00:18:57:ALPR_adapter.py: from .paddleocr import *
00:18:57:ALPR_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python37\venv\lib\site-packages\paddleocr\paddleocr.py", line 21, in
00:18:57:ALPR_adapter.py: import paddle
00:18:57:ALPR_adapter.py: ModuleNotFoundError: No module named 'paddle'
|
|
|
|
|
Try uninstall the ALPR module then reinstall the module using Do not use download cache.
|
|
|
|
|
was installed with cache off already. I uninstalled 3 times no cache and no difference. Reminds me of a previous release when .net was incrementing, but LPR was not and LPR did not work.
Anything else I can try?
|
|
|
|
|
Post your System Info, like the below screenshot.
|
|
|
|
|
Server version: 2.3.4-Beta
System: Windows
Operating System: Windows (Microsoft Windows 11 version 10.0.22621)
CPUs: Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz (Intel)
1 CPU x 6 cores. 12 logical processors (x64)
GPU: NVIDIA GeForce GTX 1060 (6 GiB) (NVIDIA)
Driver: 516.01 CUDA: 11.7.64 (max supported: 11.7) Compute: 6.1
System RAM: 32 GiB
Target: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
.NET framework: .NET 7.0.5
Video adapter info:
Intel(R) UHD Graphics 630:
Driver Version 31.0.101.2125
Video Processor Intel(R) UHD Graphics Family
NVIDIA GeForce GTX 1060:
Driver Version 31.0.15.1601
Video Processor NVIDIA GeForce GTX 1060
System GPU info:
GPU 3D Usage 1%
GPU RAM Usage 92 MiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168
|
|
|
|
|
You might have an issue downloading the paddle package, try the below link to see if you can download it.
https://paddle-wheel.bj.bcebos.com/2.5.1/windows/windows-gpu-cuda11.7-cudnn8.4.1-mkl-avx-vs2019/paddlepaddle_gpu-2.5.1.post117-cp37-cp37m-win_amd64.whl
|
|
|
|
|
Thanks for the link, but is not opening...
|
|
|
|
|
If you can not open the link and download the package you must have some firewall blocking the download.
|
|
|
|
|
If you can not download from the link I posted you can try upgrading your CUDA to 11.8. This version downloads the Paddle package from a different site that is more reliable. Below is a link to CUDA 11.8
CUDA Toolkit 11.8 Downloads | NVIDIA Developer[^]
|
|
|
|
|