PowerShell 7.5.4 (2026) PS A:\Projects\Demucs_v4_TRT\models> trtexec --loadEngine=demucsv4_sm86_trt10.15.trt --dumpLayerInfo &&&& RUNNING TensorRT.trtexec [TensorRT v101501] [b29] # C:\Program Files\NVIDIA GPU Computing Toolkit\TensorRT-10.15.1.29\bin\trtexec.exe --loadEngine=demucsv4_sm86_trt10.15.trt --dumpLayerInfo [02/18/2026-13:11:23] [I] TF32 is enabled by default. Add --noTF32 flag to further improve accuracy with some performance cost. [02/18/2026-13:11:23] [I] === Model Options === [02/18/2026-13:11:23] [I] Format: * [02/18/2026-13:11:23] [I] Model: [02/18/2026-13:11:23] [I] Output: [02/18/2026-13:11:23] [I] [02/18/2026-13:11:23] [I] === System Options === [02/18/2026-13:11:23] [I] Device: 0 [02/18/2026-13:11:23] [I] DLACore: [02/18/2026-13:11:23] [I] Plugins: [02/18/2026-13:11:23] [I] setPluginsToSerialize: [02/18/2026-13:11:23] [I] dynamicPlugins: [02/18/2026-13:11:23] [I] ignoreParsedPluginLibs: 0 [02/18/2026-13:11:23] [I] [02/18/2026-13:11:23] [I] === Inference Options === [02/18/2026-13:11:23] [I] Batch: Explicit [02/18/2026-13:11:23] [I] Input inference shapes: model [02/18/2026-13:11:23] [I] Iterations: 10 [02/18/2026-13:11:23] [I] Duration: 3s (+ 200ms warm up) [02/18/2026-13:11:23] [I] Sleep time: 0ms [02/18/2026-13:11:23] [I] Idle time: 0ms [02/18/2026-13:11:23] [I] Inference Streams: 1 [02/18/2026-13:11:23] [I] ExposeDMA: Disabled [02/18/2026-13:11:23] [I] Data transfers: Enabled [02/18/2026-13:11:23] [I] Spin-wait: Disabled [02/18/2026-13:11:23] [I] Multithreading: Disabled [02/18/2026-13:11:23] [I] CUDA Graph: Disabled [02/18/2026-13:11:23] [I] Separate profiling: Disabled [02/18/2026-13:11:23] [I] Time Deserialize: Disabled [02/18/2026-13:11:23] [I] Time Refit: Disabled [02/18/2026-13:11:23] [I] NVTX verbosity: 0 [02/18/2026-13:11:23] [I] Persistent Cache Ratio: 0 [02/18/2026-13:11:23] [I] Optimization Profile Index: 0 [02/18/2026-13:11:23] [I] Weight Streaming Budget: 100.000000% [02/18/2026-13:11:23] [I] Inputs: [02/18/2026-13:11:23] [I] Debug Tensor Save Destinations: [02/18/2026-13:11:23] [I] Dump All Debug Tensor in Formats: [02/18/2026-13:11:23] [I] === Reporting Options === [02/18/2026-13:11:23] [I] Verbose: Disabled [02/18/2026-13:11:23] [I] Averages: 10 inferences [02/18/2026-13:11:23] [I] Percentiles: 90,95,99 [02/18/2026-13:11:23] [I] Dump refittable layers:Disabled [02/18/2026-13:11:23] [I] Dump output: Disabled [02/18/2026-13:11:23] [I] Profile: Disabled [02/18/2026-13:11:23] [I] Export timing to JSON file: [02/18/2026-13:11:23] [I] Export output to JSON file: [02/18/2026-13:11:23] [I] Export profile to JSON file: [02/18/2026-13:11:23] [I] [02/18/2026-13:11:23] [I] === Device Information === [02/18/2026-13:11:23] [I] Available Devices: [02/18/2026-13:11:23] [I] Device 0: "NVIDIA GeForce RTX 3090" UUID: GPU-2bdc0e6a-b28d-3d04-b233-da75bc34e8b0 [02/18/2026-13:11:23] [I] Selected Device: NVIDIA GeForce RTX 3090 [02/18/2026-13:11:23] [I] Selected Device ID: 0 [02/18/2026-13:11:23] [I] Selected Device UUID: GPU-2bdc0e6a-b28d-3d04-b233-da75bc34e8b0 [02/18/2026-13:11:23] [I] Compute Capability: 8.6 [02/18/2026-13:11:23] [I] SMs: 82 [02/18/2026-13:11:23] [I] Device Global Memory: 24575 MiB [02/18/2026-13:11:23] [I] Shared Memory per SM: 100 KiB [02/18/2026-13:11:23] [I] Memory Bus Width: 384 bits (ECC disabled) [02/18/2026-13:11:23] [I] Application Compute Clock Rate: 1.71 GHz [02/18/2026-13:11:23] [I] Application Memory Clock Rate: 9.751 GHz [02/18/2026-13:11:23] [I] [02/18/2026-13:11:23] [I] Note: The application clock rates do not reflect the actual clock rates that the GPU is currently running at. [02/18/2026-13:11:23] [I] [02/18/2026-13:11:23] [I] TensorRT version: 10.15.1 [02/18/2026-13:11:23] [I] Loading standard plugins [02/18/2026-13:11:23] [I] [TRT] Loaded engine size: 157 MiB [02/18/2026-13:11:23] [I] Engine deserialized in 0.350218 sec. [02/18/2026-13:11:23] [I] [TRT] [MS] Running engine with multi stream info [02/18/2026-13:11:23] [I] [TRT] [MS] Number of aux streams is 2 [02/18/2026-13:11:23] [I] [TRT] [MS] Number of total worker streams is 3 [02/18/2026-13:11:23] [I] [TRT] [MS] The main stream provided by execute/enqueue calls is the first worker stream [02/18/2026-13:11:24] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +412, now: CPU 0, GPU 569 (MiB) [02/18/2026-13:11:24] [I] Setting persistentCacheLimit to 0 bytes. [02/18/2026-13:11:24] [I] Created execution context with device memory size: 403.305 MiB [02/18/2026-13:11:24] [I] Using random values for input input [02/18/2026-13:11:24] [I] Input binding for input with dimensions 1x2x343980 is created. [02/18/2026-13:11:24] [I] Output binding for output with dimensions 1x6x2x343980 is created. [02/18/2026-13:11:24] [I] Layer Information: [02/18/2026-13:11:24] [I] [TRT] The profiling verbosity was set to ProfilingVerbosity::kLAYER_NAMES_ONLY when the engine was built, so only the layer names will be returned. Rebuild the engine with ProfilingVerbosity::kDETAILED to get more verbose layer information. [02/18/2026-13:11:24] [I] Layers: Reformatting CopyNode for Network Input input __myl_Move_myl1_0 __myl_Move_myl1_1 __myl_Mean_myl1_2 __myl_Move_myl1_3 __myl_MoveSubMulMean_myl1_4 __myl_MulDivSqrtAddDiv_myl1_5 __myl_Move_myl1_6 shuffle_between_ONNXTRT_unsqueezeTensor_196_output_and_/tencoder.0/conv/Conv /tencoder.0/conv/Conv shuffle_after_/tencoder.0/conv/Conv_output /Pad_50 ONNXTRT_squeezeTensor_198 PWN(PWN(PWN(PWN(PWN(/tencoder.0/Constant_output_0 + ONNXTRT_Broadcast_200, PWN(/tencoder.0/Div)), PWN(/tencoder.0/Erf)), PWN(/tencoder.0/Constant_1_output_0 + ONNXTRT_Broadcast_202, PWN(/tencoder.0/Add))), PWN(/tencoder.0/Mul)), PWN(/tencoder.0/Constant_2_output_0 + ONNXTRT_Broadcast_204, PWN(/tencoder.0/Mul_1))) ONNXTRT_unsqueezeTensor_206 /Reshape_2 + /Reshape_3 /Pad_1_109 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_206_output_and_/tencoder.0/dconv/layers.0/layers.0.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_206_output_and_/tencoder.0/dconv/layers.0/layers.0.0/Conv /tencoder.0/dconv/layers.0/layers.0.0/Conv shuffle_after_/tencoder.0/dconv/layers.0/layers.0.0/Conv_output ONNXTRT_unsqueezeTensor shuffle_between_ONNXTRT_unsqueezeTensor_output_and_/Conv_1 Reformatting CopyNode for Input Tensor 0 to /Conv_1 || /Conv /Conv_1 || /Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/Conv_1_output shuffle_after_/Conv_1_output Reformatting CopyNode for Output Tensor 0 to shuffle_after_/Conv_1_output shuffle_after_/Conv_output_copy_input shuffle_after_/Conv_output /Conv_output copy Reformatting CopyNode for Input Tensor 0 to /Reshape_6 /Reshape_6 /Slice_2 /Slice_3 /Transpose_2 + /Reshape_7 /Cast_2 /ReduceMean /ReduceMean_1 Reformatting CopyNode for Input Tensor 0 to PWN(PWN(/Sub), PWN(/Mul_1)) Reformatting CopyNode for Input Tensor 1 to PWN(PWN(/Sub), PWN(/Mul_1)) PWN(PWN(/Sub), PWN(/Mul_1)) /ReduceMean_2 PWN(PWN(PWN(/Mul_2), PWN(/Div)), PWN(/Sqrt)) Reformatting CopyNode for Output Tensor 0 to PWN(PWN(PWN(/Mul_2), PWN(/Div)), PWN(/Sqrt)) PWN(/Constant_50_output_0 + ONNXTRT_Broadcast_188 + /Add, PWN(PWN(/Sub_2), PWN(/Div_1))) Reformatting CopyNode for Input Tensor 0 to /encoder.0/conv/Conv /encoder.0/conv/Conv PWN(PWN(PWN(PWN(PWN(/encoder.0/Constant_output_0 + ONNXTRT_Broadcast_291, PWN(/encoder.0/Div)), PWN(/encoder.0/Erf)), /encoder.0/Constant_1_output_0 + ONNXTRT_Broadcast_293 + /encoder.0/Add), PWN(/encoder.0/Mul)), /encoder.0/Constant_2_output_0 + ONNXTRT_Broadcast_295 + /encoder.0/Mul_1) /encoder.0/Transpose + /encoder.0/Reshape ONNXTRT_unsqueezeTensor_298 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_298_output_and_/encoder.0/dconv/layers.0/layers.0.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_298_output_and_/encoder.0/dconv/layers.0/layers.0.0/Conv /encoder.0/dconv/layers.0/layers.0.0/Conv shuffle_after_/encoder.0/dconv/layers.0/layers.0.0/Conv_output entry^bb^signal^1_myl49_0 entry^bb^wait^1_myl49_1 __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastAddReshMulAddDivCastErfCastAddMulMulResh_myl49_2 __myl_Move_myl49_3 __myl_ReshCastMean_myl49_4 __myl_Move_myl49_5 __myl_SubMulAddSqrtDivMulCastAddReshMulAddDivCastErfCastAddMulMulReshMean_myl49_6 exit^bb^signal^1_myl49_7 exit^bb^wait^1_myl49_8 shuffle_between_ONNXTRT_unsqueezeTensor_226_output_and_/tencoder.0/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.0/dconv/layers.0/layers.0.3/Conv /tencoder.0/dconv/layers.0/layers.0.3/Conv shuffle_after_/tencoder.0/dconv/layers.0/layers.0.3/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_318_output_and_/encoder.0/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to /encoder.0/dconv/layers.0/layers.0.3/Conv /encoder.0/dconv/layers.0/layers.0.3/Conv shuffle_after_/encoder.0/dconv/layers.0/layers.0.3/Conv_output __myl_ReshMeanSubMulMean_myl58_0 __mye8821_myl58_1 __mye8823_myl58_2 __myl_AddSqrtDivMulAddReshMulAddSlicSigmSlicMulMulAddResh_myl58_3 __myl_Move_myl58_4 __myl_ReshMean_myl58_5 __myl_Move_myl58_6 __myl_SubMulMean_myl58_7 __myl_AddSqrtDivMulAddReshMulAddSlicSigmSlicMulMulAddResh_myl58_8 exit^bb^signal^1_myl58_9 exit^bb^wait^1_myl58_10 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_245_output_and_/tencoder.0/dconv/layers.1/layers.1.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_245_output_and_/tencoder.0/dconv/layers.1/layers.1.0/Conv /tencoder.0/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tencoder.0/dconv/layers.1/layers.1.0/Conv_output shuffle_after_/tencoder.0/dconv/layers.1/layers.1.0/Conv_output Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_337_output_and_/encoder.0/dconv/layers.1/layers.1.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_337_output_and_/encoder.0/dconv/layers.1/layers.1.0/Conv /encoder.0/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/encoder.0/dconv/layers.1/layers.1.0/Conv_output shuffle_after_/encoder.0/dconv/layers.1/layers.1.0/Conv_output entry^bb^signal^1_myl69_0 entry^bb^wait^1_myl69_1 __myl_ReshMeanSubMulMeanAddSqrtDivMulAddReshMulAdd_myl69_2 __myl_DivErfAddMulMul_myl69_3 __myl_Move_myl69_4 __myl_ReshMean_myl69_5 __myl_Move_myl69_6 __myl_SubMulAddSqrtDivMulAddReshMulAddMean_myl69_7 __myl_DivErfAddMulMul_myl69_8 exit^bb^signal^1_myl69_9 exit^bb^wait^1_myl69_10 shuffle_between_ONNXTRT_unsqueezeTensor_265_output_and_/tencoder.0/dconv/layers.1/layers.1.3/Conv /tencoder.0/dconv/layers.1/layers.1.3/Conv shuffle_after_/tencoder.0/dconv/layers.1/layers.1.3/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_357_output_and_/encoder.0/dconv/layers.1/layers.1.3/Conv /encoder.0/dconv/layers.1/layers.1.3/Conv shuffle_after_/encoder.0/dconv/layers.1/layers.1.3/Conv_output entry^bb^signal^2_myl76_0 entry^bb^wait^2_myl76_1 __myl_IotaCastCastGathMulTranReshReplMul_myl76_2 __myl_ReshMeanSubMulMean_myl76_3 __mye11073_myl76_4 __mye11075_myl76_5 __myl_AddSqrtDivMulAddReshMulAddSlicSigmSlicMulMulAddReshTran_myl76_6 __myl_Move_myl76_7 __myl_ReshMean_myl76_8 __myl_Move_myl76_9 __myl_SubMulMean_myl76_10 __myl_AddSqrtDivMulAddReshMulAddSlicSigmSlicMulMulAdd_myl76_11 exit^bb^signal^1_myl76_12 exit^bb^wait^1_myl76_13 exit^bb^signal^2_myl76_14 exit^bb^wait^2_myl76_15 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_284_output_and_/tencoder.0/rewrite/Conv shuffle_between_ONNXTRT_unsqueezeTensor_284_output_and_/tencoder.0/rewrite/Conv /tencoder.0/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tencoder.0/rewrite/Conv_output shuffle_after_/tencoder.0/rewrite/Conv_output Reformatting CopyNode for Input Tensor 0 to /encoder.0/rewrite/Conv /encoder.0/rewrite/Conv Reformatting CopyNode for Output Tensor 0 to /encoder.0/rewrite/Conv ONNXTRT_squeezeTensor_286 PWN(PWN(/tencoder.0/Sigmoid), PWN(/tencoder.0/Mul_2)) /tencoder.1/Pad_462 ONNXTRT_unsqueezeTensor_464 Reformatting CopyNode for Input Tensor 2 to PWN(PWN(PWN(/encoder.0/Sigmoid), PWN(/encoder.0/Mul_2)), PWN(/Add_2)) PWN(PWN(PWN(/encoder.0/Sigmoid), PWN(/encoder.0/Mul_2)), PWN(/Add_2)) /encoder.1/conv/Conv + PWN(PWN(PWN(PWN(PWN(/encoder.1/Constant_output_0 + ONNXTRT_Broadcast_559, PWN(/encoder.1/Div)), PWN(/encoder.1/Erf)), /encoder.1/Constant_1_output_0 + ONNXTRT_Broadcast_561 + /encoder.1/Add), PWN(/encoder.1/Mul)), /encoder.1/Constant_2_output_0 + ONNXTRT_Broadcast_563 + /encoder.1/Mul_1) Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_464_output_and_/tencoder.1/conv/Conv shuffle_between_ONNXTRT_unsqueezeTensor_464_output_and_/tencoder.1/conv/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.1/conv/Conv /tencoder.1/conv/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tencoder.1/conv/Conv_output shuffle_after_/tencoder.1/conv/Conv_output ONNXTRT_squeezeTensor_466 PWN(PWN(PWN(PWN(PWN(/tencoder.1/Constant_13_output_0 + ONNXTRT_Broadcast_468, PWN(/tencoder.1/Div)), PWN(/tencoder.1/Erf)), PWN(/tencoder.1/Constant_14_output_0 + ONNXTRT_Broadcast_470, PWN(/tencoder.1/Add))), PWN(/tencoder.1/Mul)), PWN(/tencoder.1/Constant_15_output_0 + ONNXTRT_Broadcast_472, PWN(/tencoder.1/Mul_1))) ONNXTRT_unsqueezeTensor_474 Reformatting CopyNode for Input Tensor 0 to /encoder.1/Transpose + /encoder.1/Reshape /encoder.1/Transpose + /encoder.1/Reshape Reformatting CopyNode for Output Tensor 0 to /encoder.1/Transpose + /encoder.1/Reshape ONNXTRT_unsqueezeTensor_566 shuffle_between_ONNXTRT_unsqueezeTensor_566_output_and_/encoder.1/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to /encoder.1/dconv/layers.0/layers.0.0/Conv /encoder.1/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/encoder.1/dconv/layers.0/layers.0.0/Conv_output shuffle_after_/encoder.1/dconv/layers.0/layers.0.0/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_474_output_and_/tencoder.1/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.1/dconv/layers.0/layers.0.0/Conv /tencoder.1/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tencoder.1/dconv/layers.0/layers.0.0/Conv_output shuffle_after_/tencoder.1/dconv/layers.0/layers.0.0/Conv_output __myl_ReshMeanSubMulMeanAddSqrtDivMulAddReshMulAdd_myl115_0 __myl_DivErfAddMulMul_myl115_1 __myl_Move_myl115_2 __myl_ReshMean_myl115_3 __myl_Move_myl115_4 __myl_SubMulAddSqrtDivMulAddReshMulAddMean_myl115_5 __myl_DivErfAddMulMul_myl115_6 shuffle_between_ONNXTRT_unsqueezeTensor_494_output_and_/tencoder.1/dconv/layers.0/layers.0.3/Conv /tencoder.1/dconv/layers.0/layers.0.3/Conv shuffle_after_/tencoder.1/dconv/layers.0/layers.0.3/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_586_output_and_/encoder.1/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to /encoder.1/dconv/layers.0/layers.0.3/Conv /encoder.1/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/encoder.1/dconv/layers.0/layers.0.3/Conv_output shuffle_after_/encoder.1/dconv/layers.0/layers.0.3/Conv_output Reformatting CopyNode for Input Tensor 0 to {ForeignNode[/tencoder.1/dconv/layers.0/layers.0.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_499...ONNXTRT_unsqueezeTensor_513]} __myl_Move_myl125_0 __myl_Move_myl125_1 __myl_ReshCastSubMulMeanMean_myl125_2 __mye8837_myl125_3 __mye8839_myl125_4 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAddResh_myl125_5 __myl_Move_myl125_6 __myl_ReshCastMean_myl125_7 __myl_Move_myl125_8 __myl_SubMulMean_myl125_9 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAddResh_myl125_10 exit^bb^signal^1_myl125_11 exit^bb^wait^1_myl125_12 shuffle_between_ONNXTRT_unsqueezeTensor_513_output_and_/tencoder.1/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.1/dconv/layers.1/layers.1.0/Conv /tencoder.1/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tencoder.1/dconv/layers.1/layers.1.0/Conv_output shuffle_after_/tencoder.1/dconv/layers.1/layers.1.0/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_605_output_and_/encoder.1/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to /encoder.1/dconv/layers.1/layers.1.0/Conv /encoder.1/dconv/layers.1/layers.1.0/Conv shuffle_after_/encoder.1/dconv/layers.1/layers.1.0/Conv_output Reformatting CopyNode for Input Tensor 1 to {ForeignNode[/tencoder.1/dconv/layers.1/layers.1.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_518...ONNXTRT_unsqueezeTensor_533]} __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastAddReshMulAdd_myl136_0 __myl_DivCastErfCastAddMulMul_myl136_1 __myl_Move_myl136_2 __myl_ReshCastMean_myl136_3 __myl_Move_myl136_4 __myl_SubMulAddSqrtDivMulCastAddReshMulAddMean_myl136_5 __myl_DivCastErfCastAddMulMul_myl136_6 shuffle_between_ONNXTRT_unsqueezeTensor_533_output_and_/tencoder.1/dconv/layers.1/layers.1.3/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.1/dconv/layers.1/layers.1.3/Conv /tencoder.1/dconv/layers.1/layers.1.3/Conv shuffle_after_/tencoder.1/dconv/layers.1/layers.1.3/Conv_output Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_625_output_and_/encoder.1/dconv/layers.1/layers.1.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_625_output_and_/encoder.1/dconv/layers.1/layers.1.3/Conv /encoder.1/dconv/layers.1/layers.1.3/Conv shuffle_after_/encoder.1/dconv/layers.1/layers.1.3/Conv_output Reformatting CopyNode for Input Tensor 2 to {ForeignNode[/tencoder.1/dconv/layers.1/layers.1.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_538...ONNXTRT_unsqueezeTensor_552]} Reformatting CopyNode for Input Tensor 3 to {ForeignNode[/tencoder.1/dconv/layers.1/layers.1.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_538...ONNXTRT_unsqueezeTensor_552]} __myl_Move_myl147_0 __myl_Move_myl147_1 __myl_ReshSubMulMeanMean_myl147_2 __mye8954_myl147_3 __mye8956_myl147_4 __myl_AddSqrtDivMulAddReshMulAddSlicSigmSlicMulMulAddReshTran_myl147_5 __myl_Move_myl147_6 __myl_ReshMean_myl147_7 __myl_Move_myl147_8 __myl_SubMulMean_myl147_9 __myl_AddSqrtDivMulAddReshMulAddSlicSigmSlicMulMulAdd_myl147_10 exit^bb^signal^1_myl147_11 exit^bb^wait^1_myl147_12 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_552_output_and_/tencoder.1/rewrite/Conv shuffle_between_ONNXTRT_unsqueezeTensor_552_output_and_/tencoder.1/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.1/rewrite/Conv /tencoder.1/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tencoder.1/rewrite/Conv_output shuffle_after_/tencoder.1/rewrite/Conv_output Reformatting CopyNode for Input Tensor 0 to /encoder.1/rewrite/Conv /encoder.1/rewrite/Conv ONNXTRT_squeezeTensor_554 Reformatting CopyNode for Input Tensor 0 to PWN(PWN(/tencoder.1/Sigmoid), PWN(/tencoder.1/Mul_2)) Reformatting CopyNode for Input Tensor 1 to PWN(PWN(/tencoder.1/Sigmoid), PWN(/tencoder.1/Mul_2)) PWN(PWN(/tencoder.1/Sigmoid), PWN(/tencoder.1/Mul_2)) /tencoder.2/Pad_705 ONNXTRT_unsqueezeTensor_707 PWN(PWN(/encoder.1/Sigmoid), PWN(/encoder.1/Mul_2)) Reformatting CopyNode for Output Tensor 0 to PWN(PWN(/encoder.1/Sigmoid), PWN(/encoder.1/Mul_2)) Reformatting CopyNode for Input Tensor 0 to /encoder.2/conv/Conv + PWN(PWN(PWN(PWN(PWN(/encoder.2/Constant_output_0 + ONNXTRT_Broadcast_802, PWN(/encoder.2/Div)), PWN(/encoder.2/Erf)), /encoder.2/Constant_1_output_0 + ONNXTRT_Broadcast_804 + /encoder.2/Add), PWN(/encoder.2/Mul)), /encoder.2/Constant_2_output_0 + ONNXTRT_Broadcast_806 + /encoder.2/Mul_1) /encoder.2/conv/Conv + PWN(PWN(PWN(PWN(PWN(/encoder.2/Constant_output_0 + ONNXTRT_Broadcast_802, PWN(/encoder.2/Div)), PWN(/encoder.2/Erf)), /encoder.2/Constant_1_output_0 + ONNXTRT_Broadcast_804 + /encoder.2/Add), PWN(/encoder.2/Mul)), /encoder.2/Constant_2_output_0 + ONNXTRT_Broadcast_806 + /encoder.2/Mul_1) shuffle_between_ONNXTRT_unsqueezeTensor_707_output_and_/tencoder.2/conv/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.2/conv/Conv /tencoder.2/conv/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tencoder.2/conv/Conv_output shuffle_after_/tencoder.2/conv/Conv_output ONNXTRT_squeezeTensor_709 PWN(PWN(PWN(PWN(PWN(/tencoder.2/Constant_12_output_0 + ONNXTRT_Broadcast_711, PWN(/tencoder.2/Div)), PWN(/tencoder.2/Erf)), PWN(/tencoder.2/Constant_13_output_0 + ONNXTRT_Broadcast_713, PWN(/tencoder.2/Add))), PWN(/tencoder.2/Mul)), PWN(/tencoder.2/Constant_14_output_0 + ONNXTRT_Broadcast_715, PWN(/tencoder.2/Mul_1))) ONNXTRT_unsqueezeTensor_717 Reformatting CopyNode for Input Tensor 0 to /encoder.2/Transpose + /encoder.2/Reshape /encoder.2/Transpose + /encoder.2/Reshape Reformatting CopyNode for Output Tensor 0 to /encoder.2/Transpose + /encoder.2/Reshape Reformatting CopyNode for Input Tensor 0 to ONNXTRT_unsqueezeTensor_809 ONNXTRT_unsqueezeTensor_809 shuffle_between_ONNXTRT_unsqueezeTensor_809_output_and_/encoder.2/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to /encoder.2/dconv/layers.0/layers.0.0/Conv /encoder.2/dconv/layers.0/layers.0.0/Conv shuffle_after_/encoder.2/dconv/layers.0/layers.0.0/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_717_output_and_/tencoder.2/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.2/dconv/layers.0/layers.0.0/Conv /tencoder.2/dconv/layers.0/layers.0.0/Conv shuffle_after_/tencoder.2/dconv/layers.0/layers.0.0/Conv_output Reformatting CopyNode for Input Tensor 0 to {ForeignNode[/tencoder.2/dconv/layers.0/layers.0.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_722...ONNXTRT_unsqueezeTensor_737]} Reformatting CopyNode for Input Tensor 1 to {ForeignNode[/tencoder.2/dconv/layers.0/layers.0.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_722...ONNXTRT_unsqueezeTensor_737]} __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastAddReshMulAdd_myl189_0 __myl_DivCastErfCastAddMulMul_myl189_1 __myl_Move_myl189_2 __myl_ReshCastMean_myl189_3 __myl_Move_myl189_4 __myl_SubMulAddSqrtDivMulCastAddReshMulAddMean_myl189_5 __myl_DivCastErfCastAddMulMul_myl189_6 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_737_output_and_/tencoder.2/dconv/layers.0/layers.0.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_737_output_and_/tencoder.2/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.2/dconv/layers.0/layers.0.3/Conv /tencoder.2/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tencoder.2/dconv/layers.0/layers.0.3/Conv_output shuffle_after_/tencoder.2/dconv/layers.0/layers.0.3/Conv_output Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_829_output_and_/encoder.2/dconv/layers.0/layers.0.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_829_output_and_/encoder.2/dconv/layers.0/layers.0.3/Conv /encoder.2/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/encoder.2/dconv/layers.0/layers.0.3/Conv_output shuffle_after_/encoder.2/dconv/layers.0/layers.0.3/Conv_output Reformatting CopyNode for Input Tensor 2 to {ForeignNode[/tencoder.2/dconv/layers.0/layers.0.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_742...ONNXTRT_unsqueezeTensor_756]} __myl_Move_myl202_0 __myl_Move_myl202_1 __myl_ReshCastSubMulMeanMean_myl202_2 __mye8837_myl202_3 __mye8839_myl202_4 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAddResh_myl202_5 __myl_Move_myl202_6 __myl_ReshCastMean_myl202_7 __myl_Move_myl202_8 __myl_SubMulMean_myl202_9 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAddResh_myl202_10 exit^bb^signal^1_myl202_11 exit^bb^wait^1_myl202_12 shuffle_between_ONNXTRT_unsqueezeTensor_756_output_and_/tencoder.2/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.2/dconv/layers.1/layers.1.0/Conv /tencoder.2/dconv/layers.1/layers.1.0/Conv shuffle_after_/tencoder.2/dconv/layers.1/layers.1.0/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_848_output_and_/encoder.2/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to /encoder.2/dconv/layers.1/layers.1.0/Conv /encoder.2/dconv/layers.1/layers.1.0/Conv shuffle_after_/encoder.2/dconv/layers.1/layers.1.0/Conv_output Reformatting CopyNode for Input Tensor 0 to {ForeignNode[/tencoder.2/dconv/layers.1/layers.1.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_761...ONNXTRT_unsqueezeTensor_776]} Reformatting CopyNode for Input Tensor 1 to {ForeignNode[/tencoder.2/dconv/layers.1/layers.1.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_761...ONNXTRT_unsqueezeTensor_776]} __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastAddReshMulAdd_myl213_0 __myl_DivCastErfCastAddMulMul_myl213_1 __myl_Move_myl213_2 __myl_ReshCastMean_myl213_3 __myl_Move_myl213_4 __myl_SubMulAddSqrtDivMulCastAddReshMulAddMean_myl213_5 __myl_DivCastErfCastAddMulMul_myl213_6 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_776_output_and_/tencoder.2/dconv/layers.1/layers.1.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_776_output_and_/tencoder.2/dconv/layers.1/layers.1.3/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.2/dconv/layers.1/layers.1.3/Conv /tencoder.2/dconv/layers.1/layers.1.3/Conv shuffle_after_/tencoder.2/dconv/layers.1/layers.1.3/Conv_output Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_868_output_and_/encoder.2/dconv/layers.1/layers.1.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_868_output_and_/encoder.2/dconv/layers.1/layers.1.3/Conv /encoder.2/dconv/layers.1/layers.1.3/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/encoder.2/dconv/layers.1/layers.1.3/Conv_output shuffle_after_/encoder.2/dconv/layers.1/layers.1.3/Conv_output Reformatting CopyNode for Input Tensor 0 to {ForeignNode[/tencoder.2/dconv/layers.1/layers.1.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_781...ONNXTRT_unsqueezeTensor_795]} Reformatting CopyNode for Input Tensor 1 to {ForeignNode[/tencoder.2/dconv/layers.1/layers.1.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_781...ONNXTRT_unsqueezeTensor_795]} Reformatting CopyNode for Input Tensor 2 to {ForeignNode[/tencoder.2/dconv/layers.1/layers.1.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_781...ONNXTRT_unsqueezeTensor_795]} Reformatting CopyNode for Input Tensor 3 to {ForeignNode[/tencoder.2/dconv/layers.1/layers.1.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_781...ONNXTRT_unsqueezeTensor_795]} __myl_Move_myl228_0 __myl_Move_myl228_1 __myl_ReshSubMulMeanMean_myl228_2 __mye8954_myl228_3 __mye8956_myl228_4 __myl_AddSqrtDivMulAddReshMulAddSlicSigmSlicMulMulAddReshTran_myl228_5 __myl_Move_myl228_6 __myl_ReshMean_myl228_7 __myl_Move_myl228_8 __myl_SubMulMean_myl228_9 __myl_AddSqrtDivMulAddReshMulAddSlicSigmSlicMulMulAdd_myl228_10 exit^bb^signal^1_myl228_11 exit^bb^wait^1_myl228_12 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_795_output_and_/tencoder.2/rewrite/Conv shuffle_between_ONNXTRT_unsqueezeTensor_795_output_and_/tencoder.2/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.2/rewrite/Conv /tencoder.2/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tencoder.2/rewrite/Conv_output shuffle_after_/tencoder.2/rewrite/Conv_output Reformatting CopyNode for Input Tensor 0 to /encoder.2/rewrite/Conv /encoder.2/rewrite/Conv Reformatting CopyNode for Output Tensor 0 to /encoder.2/rewrite/Conv ONNXTRT_squeezeTensor_797 PWN(PWN(/tencoder.2/Sigmoid), PWN(/tencoder.2/Mul_2)) /tencoder.3/Pad_948 ONNXTRT_unsqueezeTensor_950 PWN(PWN(/encoder.2/Sigmoid), PWN(/encoder.2/Mul_2)) Reformatting CopyNode for Output Tensor 0 to PWN(PWN(/encoder.2/Sigmoid), PWN(/encoder.2/Mul_2)) Reformatting CopyNode for Input Tensor 0 to /encoder.3/conv/Conv + PWN(PWN(PWN(PWN(PWN(/encoder.3/Constant_output_0 + ONNXTRT_Broadcast_1045, PWN(/encoder.3/Div)), PWN(/encoder.3/Erf)), /encoder.3/Constant_1_output_0 + ONNXTRT_Broadcast_1047 + /encoder.3/Add), PWN(/encoder.3/Mul)), /encoder.3/Constant_2_output_0 + ONNXTRT_Broadcast_1049 + /encoder.3/Mul_1) /encoder.3/conv/Conv + PWN(PWN(PWN(PWN(PWN(/encoder.3/Constant_output_0 + ONNXTRT_Broadcast_1045, PWN(/encoder.3/Div)), PWN(/encoder.3/Erf)), /encoder.3/Constant_1_output_0 + ONNXTRT_Broadcast_1047 + /encoder.3/Add), PWN(/encoder.3/Mul)), /encoder.3/Constant_2_output_0 + ONNXTRT_Broadcast_1049 + /encoder.3/Mul_1) Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_950_output_and_/tencoder.3/conv/Conv shuffle_between_ONNXTRT_unsqueezeTensor_950_output_and_/tencoder.3/conv/Conv /tencoder.3/conv/Conv shuffle_after_/tencoder.3/conv/Conv_output Reformatting CopyNode for Input Tensor 0 to ONNXTRT_squeezeTensor_952 ONNXTRT_squeezeTensor_952 PWN(PWN(PWN(PWN(PWN(/tencoder.3/Constant_12_output_0 + ONNXTRT_Broadcast_954, PWN(/tencoder.3/Div)), PWN(/tencoder.3/Erf)), PWN(/tencoder.3/Constant_13_output_0 + ONNXTRT_Broadcast_956, PWN(/tencoder.3/Add))), PWN(/tencoder.3/Mul)), PWN(/tencoder.3/Constant_14_output_0 + ONNXTRT_Broadcast_958, PWN(/tencoder.3/Mul_1))) ONNXTRT_unsqueezeTensor_960 /encoder.3/Transpose + /encoder.3/Reshape Reformatting CopyNode for Output Tensor 0 to /encoder.3/Transpose + /encoder.3/Reshape ONNXTRT_unsqueezeTensor_1052 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_1052_output_and_/encoder.3/dconv/layers.0/layers.0.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_1052_output_and_/encoder.3/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to /encoder.3/dconv/layers.0/layers.0.0/Conv /encoder.3/dconv/layers.0/layers.0.0/Conv shuffle_after_/encoder.3/dconv/layers.0/layers.0.0/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_960_output_and_/tencoder.3/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.3/dconv/layers.0/layers.0.0/Conv /tencoder.3/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tencoder.3/dconv/layers.0/layers.0.0/Conv_output shuffle_after_/tencoder.3/dconv/layers.0/layers.0.0/Conv_output Reformatting CopyNode for Input Tensor 0 to {ForeignNode[/tencoder.3/dconv/layers.0/layers.0.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_965...ONNXTRT_unsqueezeTensor_980]} Reformatting CopyNode for Input Tensor 1 to {ForeignNode[/tencoder.3/dconv/layers.0/layers.0.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_965...ONNXTRT_unsqueezeTensor_980]} __myl_ReshCastMeanSubMulMean_myl269_0 __myl_AddSqrtDivMulCastAddReshMulAdd_myl269_1 __myl_DivCastErfCastAddMulMul_myl269_2 __myl_Move_myl269_3 __myl_ReshCastMean_myl269_4 __myl_Move_myl269_5 __myl_SubMulAddSqrtDivMulCastAddReshMulAddMean_myl269_6 __myl_DivCastErfCastAddMulMul_myl269_7 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_980_output_and_/tencoder.3/dconv/layers.0/layers.0.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_980_output_and_/tencoder.3/dconv/layers.0/layers.0.3/Conv /tencoder.3/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tencoder.3/dconv/layers.0/layers.0.3/Conv_output shuffle_after_/tencoder.3/dconv/layers.0/layers.0.3/Conv_output Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_1072_output_and_/encoder.3/dconv/layers.0/layers.0.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_1072_output_and_/encoder.3/dconv/layers.0/layers.0.3/Conv /encoder.3/dconv/layers.0/layers.0.3/Conv shuffle_after_/encoder.3/dconv/layers.0/layers.0.3/Conv_output Reformatting CopyNode for Input Tensor 1 to {ForeignNode[/tencoder.3/dconv/layers.0/layers.0.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_985...ONNXTRT_unsqueezeTensor_999]} __myl_Move_myl280_0 __myl_Move_myl280_1 __myl_ReshCastSubMulMeanMean_myl280_2 __mye8837_myl280_3 __mye8839_myl280_4 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAddResh_myl280_5 __myl_Move_myl280_6 __myl_ReshCastMean_myl280_7 __myl_Move_myl280_8 __myl_SubMulMean_myl280_9 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAddResh_myl280_10 exit^bb^signal^1_myl280_11 exit^bb^wait^1_myl280_12 shuffle_between_ONNXTRT_unsqueezeTensor_999_output_and_/tencoder.3/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.3/dconv/layers.1/layers.1.0/Conv /tencoder.3/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tencoder.3/dconv/layers.1/layers.1.0/Conv_output shuffle_after_/tencoder.3/dconv/layers.1/layers.1.0/Conv_output Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_1091_output_and_/encoder.3/dconv/layers.1/layers.1.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_1091_output_and_/encoder.3/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to /encoder.3/dconv/layers.1/layers.1.0/Conv /encoder.3/dconv/layers.1/layers.1.0/Conv shuffle_after_/encoder.3/dconv/layers.1/layers.1.0/Conv_output Reformatting CopyNode for Input Tensor 1 to {ForeignNode[/tencoder.3/dconv/layers.1/layers.1.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_1004...ONNXTRT_unsqueezeTensor_1019]} __myl_ReshMeanSubMulMean_myl292_0 __myl_AddSqrtDivMulAddReshMulAdd_myl292_1 __myl_DivErfAddMulMul_myl292_2 __myl_Move_myl292_3 __myl_ReshMean_myl292_4 __myl_Move_myl292_5 __myl_SubMulAddSqrtDivMulAddReshMulAddMean_myl292_6 __myl_DivErfAddMulMul_myl292_7 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_1019_output_and_/tencoder.3/dconv/layers.1/layers.1.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_1019_output_and_/tencoder.3/dconv/layers.1/layers.1.3/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.3/dconv/layers.1/layers.1.3/Conv /tencoder.3/dconv/layers.1/layers.1.3/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tencoder.3/dconv/layers.1/layers.1.3/Conv_output shuffle_after_/tencoder.3/dconv/layers.1/layers.1.3/Conv_output Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_1111_output_and_/encoder.3/dconv/layers.1/layers.1.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_1111_output_and_/encoder.3/dconv/layers.1/layers.1.3/Conv /encoder.3/dconv/layers.1/layers.1.3/Conv shuffle_after_/encoder.3/dconv/layers.1/layers.1.3/Conv_output Reformatting CopyNode for Input Tensor 1 to {ForeignNode[/tencoder.3/dconv/layers.1/layers.1.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_1024...ONNXTRT_unsqueezeTensor_1038]} __myl_Move_myl304_0 __myl_Move_myl304_1 __myl_ReshCastSubMulMeanMean_myl304_2 __mye8946_myl304_3 __mye8948_myl304_4 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAddReshTran_myl304_5 __myl_Move_myl304_6 __myl_ReshCastMean_myl304_7 __myl_Move_myl304_8 __myl_SubMulMean_myl304_9 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAdd_myl304_10 exit^bb^signal^1_myl304_11 exit^bb^wait^1_myl304_12 shuffle_between_ONNXTRT_unsqueezeTensor_1038_output_and_/tencoder.3/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to /tencoder.3/rewrite/Conv /tencoder.3/rewrite/Conv shuffle_after_/tencoder.3/rewrite/Conv_output Reformatting CopyNode for Input Tensor 0 to /encoder.3/rewrite/Conv /encoder.3/rewrite/Conv __myl_Repl_myl311_0 __myl_IotaCastSlicReshReplReshIotaCastReshReplReshIotaCastReshReplReshConcCastSlicReshReplReshEtc_myl311_1 __myl_CastAddReshMulSinTranReshReplScat_myl311_2 __myl_CosTranReshReplScat_myl311_3 __myl_CastAddReshMulSinTranReshReplScat_myl311_4 __myl_CosTranReshReplScat_myl311_5 __myl_ReshTranReshSlicSlicSigmMulTranReshMoveCastMeanSubMulMeanAddSqrtDivMulCastMulAddAddCastMeanEtc_myl311_6 /crosstransformer/layers.0/self_attn/MatMul_myl311_7 __myl_TranReshSlicSlicSlicReshTranReshTranReshMove_myl311_8 _gemm_mha_v2_myl311_9 /crosstransformer/layers.0/self_attn/Gemm_myl311_10 __myl_MulAddReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl311_11 __myl_Fc_myl311_12 /crosstransformer/layers.0/linear2/MatMul_myl311_13 __myl_MulAddTranResh_myl311_14 __myl_Move_myl311_15 __myl_CastMean_myl311_16 __myl_Move_myl311_17 __myl_SubMulMean_myl311_18 __myl_AddSqrtDivMulCastAddReshMulAddTran_myl311_19 __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastMulAddMulAdd_myl311_20 /crosstransformer/layers_t.1/cross_attn/MatMul_1_myl311_21 __myl_TranReshSlicSlicReshTranReshTranReshMove_myl311_22 __myl_ReshSlicSlicSigmMulCast_myl311_23 __myl_Tran_myl311_24 __myl_IotaCastReshCastIotaCastReshCastMulCastCastPowCastDivMulSinCosConcReshCastMeanSubMulMeanAddEtc_myl311_25 /crosstransformer/layers_t.0/self_attn/MatMul_myl311_26 __myl_TranReshSlicSlicSlicReshTranReshTranReshMove_myl311_27 _gemm_mha_v2_myl311_28 /crosstransformer/layers_t.0/self_attn/Gemm_myl311_29 __myl_MulAddReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl311_30 __myl_Fc_myl311_31 /crosstransformer/layers_t.0/linear2/MatMul_myl311_32 __myl_MulAddTranResh_myl311_33 __myl_Move_myl311_34 __myl_CastMean_myl311_35 __myl_Move_myl311_36 __myl_SubMulMean_myl311_37 __myl_AddSqrtDivMulCastAddReshMulAddTran_myl311_38 __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastMulAddMulAdd_myl311_39 /crosstransformer/layers_t.1/cross_attn/MatMul_myl311_40 _gemm_mha_v2_myl311_41 /crosstransformer/layers_t.1/cross_attn/Gemm_myl311_42 __myl_MulAddReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl311_43 __myl_Fc_myl311_44 /crosstransformer/layers_t.1/linear2/MatMul_myl311_45 __myl_MulAddTranResh_myl311_46 __myl_Move_myl311_47 __myl_CastMean_myl311_48 __myl_Move_myl311_49 __myl_SubMulMean_myl311_50 __myl_AddSqrtDivMulCastAddReshMulAddTran_myl311_51 __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl311_52 /crosstransformer/layers_t.2/self_attn/MatMul_myl311_53 __myl_TranReshSlicSlicReshTranReshTranSlicReshMove_myl311_54 _gemm_mha_v2_myl311_55 /crosstransformer/layers_t.2/self_attn/Gemm_myl311_56 __myl_MulAddReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl311_57 __myl_Fc_myl311_58 /crosstransformer/layers_t.2/linear2/MatMul_myl311_59 __myl_MulAddTranResh_myl311_60 __myl_Move_myl311_61 __myl_CastMean_myl311_62 __myl_Move_myl311_63 __myl_SubMulMean_myl311_64 __myl_AddSqrtDivMulCastAddReshMulAddTranCast_myl311_65 __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl311_66 /crosstransformer/layers.3/cross_attn/MatMul_1_myl311_67 __myl_TranReshSlicSlicReshTranReshTranReshMove_myl311_68 /crosstransformer/layers.1/cross_attn/MatMul_myl311_69 /crosstransformer/layers.1/cross_attn/MatMul_1_myl311_70 __myl_TranReshSlicSlicReshTranReshTranReshMove_myl311_71 _gemm_mha_v2_myl311_72 /crosstransformer/layers.1/cross_attn/Gemm_myl311_73 __myl_MulAddReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl311_74 __myl_Fc_myl311_75 /crosstransformer/layers.1/linear2/MatMul_myl311_76 __myl_MulAddTranResh_myl311_77 __myl_Move_myl311_78 __myl_CastMean_myl311_79 __myl_Move_myl311_80 __myl_SubMulMean_myl311_81 __myl_AddSqrtDivMulCastAddReshMulAddTran_myl311_82 __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl311_83 /crosstransformer/layers.2/self_attn/MatMul_myl311_84 __myl_TranReshSlicSlicReshTranReshTranSlicReshMove_myl311_85 _gemm_mha_v2_myl311_86 /crosstransformer/layers.2/self_attn/Gemm_myl311_87 __myl_MulAddReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl311_88 __myl_Fc_myl311_89 /crosstransformer/layers.2/linear2/MatMul_myl311_90 __myl_MulAddTranResh_myl311_91 __myl_Move_myl311_92 __myl_CastMean_myl311_93 __myl_Move_myl311_94 __myl_SubMulMean_myl311_95 __myl_AddSqrtDivMulCastAddReshMulAddTranCast_myl311_96 __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl311_97 /crosstransformer/layers.3/cross_attn/MatMul_myl311_98 _gemm_mha_v2_myl311_99 /crosstransformer/layers.3/cross_attn/Gemm_myl311_100 __myl_MulAddReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl311_101 __myl_Fc_myl311_102 /crosstransformer/layers.3/linear2/MatMul_myl311_103 __myl_MulAddTranResh_myl311_104 __myl_Move_myl311_105 __myl_CastMean_myl311_106 __myl_Move_myl311_107 __myl_SubMulMean_myl311_108 __myl_AddSqrtDivMulCastAddReshMulAddTran_myl311_109 __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl311_110 /crosstransformer/layers.4/self_attn/MatMul_myl311_111 __myl_TranReshSlicSlicReshTranReshTranSlicReshMove_myl311_112 _gemm_mha_v2_myl311_113 /crosstransformer/layers.4/self_attn/Gemm_myl311_114 __myl_MulAddReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl311_115 __myl_Fc_myl311_116 /crosstransformer/layers.4/linear2/MatMul_myl311_117 __myl_MulAddTranResh_myl311_118 __myl_Move_myl311_119 __myl_CastMean_myl311_120 __myl_Move_myl311_121 __myl_SubMulMean_myl311_122 __myl_AddSqrtDivMulCastAddReshMulAddTranReshTranAdd_myl311_123 /decoder.0/rewrite/Conv Reformatting CopyNode for Output Tensor 0 to /decoder.0/rewrite/Conv PWN(PWN(/decoder.0/Sigmoid), PWN(/decoder.0/Mul)) Reformatting CopyNode for Input Tensor 0 to /decoder.0/Transpose + /decoder.0/Reshape /decoder.0/Transpose + /decoder.0/Reshape Reformatting CopyNode for Output Tensor 0 to /decoder.0/Transpose + /decoder.0/Reshape ONNXTRT_unsqueezeTensor_4580 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_4580_output_and_/decoder.0/dconv/layers.0/layers.0.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_4580_output_and_/decoder.0/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to /decoder.0/dconv/layers.0/layers.0.0/Conv /decoder.0/dconv/layers.0/layers.0.0/Conv shuffle_after_/decoder.0/dconv/layers.0/layers.0.0/Conv_output Reformatting CopyNode for Input Tensor 0 to {ForeignNode[/crosstransformer/layers_t.3/cross_attn/Cast_2...ONNXTRT_unsqueezeTensor_4600]} Reformatting CopyNode for Input Tensor 1 to {ForeignNode[/crosstransformer/layers_t.3/cross_attn/Cast_2...ONNXTRT_unsqueezeTensor_4600]} Reformatting CopyNode for Input Tensor 2 to {ForeignNode[/crosstransformer/layers_t.3/cross_attn/Cast_2...ONNXTRT_unsqueezeTensor_4600]} Reformatting CopyNode for Input Tensor 3 to {ForeignNode[/crosstransformer/layers_t.3/cross_attn/Cast_2...ONNXTRT_unsqueezeTensor_4600]} __myl_CastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl328_0 /crosstransformer/layers_t.3/cross_attn/MatMul_1_myl328_1 __mye29407_myl328_2 __mye29409_myl328_3 __myl_TranReshSlicSlicReshTranReshTranReshMove_myl328_4 __mye29411_myl328_5 __myl_CastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl328_6 /crosstransformer/layers_t.3/cross_attn/MatMul_myl328_7 __mye29413_myl328_8 _gemm_mha_v2_myl328_9 /crosstransformer/layers_t.3/cross_attn/Gemm_myl328_10 __myl_MulAddReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl328_11 __myl_Fc_myl328_12 /crosstransformer/layers_t.3/linear2/MatMul_myl328_13 __myl_MulAddTranResh_myl328_14 __myl_Move_myl328_15 __myl_CastMean_myl328_16 __myl_Move_myl328_17 __myl_SubMulMean_myl328_18 __myl_AddSqrtDivMulCastAddReshMulAddTran_myl328_19 __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl328_20 /crosstransformer/layers_t.4/self_attn/MatMul_myl328_21 __myl_TranReshSlicSlicReshTranReshTranSlicReshMove_myl328_22 _gemm_mha_v2_myl328_23 /crosstransformer/layers_t.4/self_attn/Gemm_myl328_24 __myl_MulAddReshCastMeanSubMulMeanAddSqrtDivMulCastMulAdd_myl328_25 __myl_Fc_myl328_26 /crosstransformer/layers_t.4/linear2/MatMul_myl328_27 __myl_MulAddTranResh_myl328_28 __myl_Move_myl328_29 __myl_CastMean_myl328_30 __myl_Move_myl328_31 __myl_SubMulAddSqrtDivMulCastAddReshMulAddAddMean_myl328_32 __myl_ReshCastMeanSubMulMean_myl328_33 __myl_AddSqrtDivMulCastAddReshMulAdd_myl328_34 __myl_DivCastErfCastAddMulMul_myl328_35 shuffle_between_ONNXTRT_unsqueezeTensor_4698_output_and_/tdecoder.0/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.0/rewrite/Conv /tdecoder.0/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tdecoder.0/rewrite/Conv_output shuffle_after_/tdecoder.0/rewrite/Conv_output ONNXTRT_squeezeTensor_4700 PWN(PWN(/tdecoder.0/Sigmoid), PWN(/tdecoder.0/Mul)) ONNXTRT_unsqueezeTensor_4705 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_4705_output_and_/tdecoder.0/dconv/layers.0/layers.0.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_4705_output_and_/tdecoder.0/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.0/dconv/layers.0/layers.0.0/Conv /tdecoder.0/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tdecoder.0/dconv/layers.0/layers.0.0/Conv_output shuffle_after_/tdecoder.0/dconv/layers.0/layers.0.0/Conv_output Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_4600_output_and_/decoder.0/dconv/layers.0/layers.0.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_4600_output_and_/decoder.0/dconv/layers.0/layers.0.3/Conv /decoder.0/dconv/layers.0/layers.0.3/Conv shuffle_after_/decoder.0/dconv/layers.0/layers.0.3/Conv_output Reformatting CopyNode for Input Tensor 0 to {ForeignNode[/tdecoder.0/dconv/layers.0/layers.0.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_4710...ONNXTRT_unsqueezeTensor_4619]} Reformatting CopyNode for Input Tensor 1 to {ForeignNode[/tdecoder.0/dconv/layers.0/layers.0.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_4710...ONNXTRT_unsqueezeTensor_4619]} __myl_Move_myl349_0 __myl_ReshCastMean_myl349_1 __myl_Move_myl349_2 __myl_SubMulAddSqrtDivMulCastAddReshMulAddMean_myl349_3 __myl_DivCastErfCastAddMulMul_myl349_4 __myl_Move_myl349_5 __myl_Move_myl349_6 __myl_ReshCastSubMulMeanMean_myl349_7 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAddResh_myl349_8 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_4725_output_and_/tdecoder.0/dconv/layers.0/layers.0.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_4725_output_and_/tdecoder.0/dconv/layers.0/layers.0.3/Conv /tdecoder.0/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tdecoder.0/dconv/layers.0/layers.0.3/Conv_output shuffle_after_/tdecoder.0/dconv/layers.0/layers.0.3/Conv_output Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_4619_output_and_/decoder.0/dconv/layers.1/layers.1.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_4619_output_and_/decoder.0/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to /decoder.0/dconv/layers.1/layers.1.0/Conv /decoder.0/dconv/layers.1/layers.1.0/Conv shuffle_after_/decoder.0/dconv/layers.1/layers.1.0/Conv_output Reformatting CopyNode for Input Tensor 2 to {ForeignNode[/tdecoder.0/dconv/layers.0/layers.0.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_4730...ONNXTRT_unsqueezeTensor_4639]} __myl_Move_myl361_0 __myl_ReshMean_myl361_1 __myl_Move_myl361_2 __myl_SubMulMean_myl361_3 __myl_AddSqrtDivMulAddReshMulAddSlicSigmSlicMulMulAddResh_myl361_4 __myl_ReshMeanSubMulMean_myl361_5 __myl_AddSqrtDivMulAddReshMulAdd_myl361_6 __myl_DivErfAddMulMul_myl361_7 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_4744_output_and_/tdecoder.0/dconv/layers.1/layers.1.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_4744_output_and_/tdecoder.0/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.0/dconv/layers.1/layers.1.0/Conv /tdecoder.0/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tdecoder.0/dconv/layers.1/layers.1.0/Conv_output shuffle_after_/tdecoder.0/dconv/layers.1/layers.1.0/Conv_output Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_4639_output_and_/decoder.0/dconv/layers.1/layers.1.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_4639_output_and_/decoder.0/dconv/layers.1/layers.1.3/Conv /decoder.0/dconv/layers.1/layers.1.3/Conv shuffle_after_/decoder.0/dconv/layers.1/layers.1.3/Conv_output Reformatting CopyNode for Input Tensor 0 to {ForeignNode[/tdecoder.0/dconv/layers.1/layers.1.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_4749.../decoder.0/Reshape_1 + /decoder.0/Transpose_1]} Reformatting CopyNode for Input Tensor 1 to {ForeignNode[/tdecoder.0/dconv/layers.1/layers.1.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_4749.../decoder.0/Reshape_1 + /decoder.0/Transpose_1]} __myl_Move_myl374_0 __myl_ReshCastMean_myl374_1 __myl_Move_myl374_2 __myl_SubMulAddSqrtDivMulCastAddReshMulAddMean_myl374_3 __myl_DivCastErfCastAddMulMul_myl374_4 __myl_Move_myl374_5 __myl_Move_myl374_6 __myl_ReshCastSubMulMeanMean_myl374_7 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAddReshTran_myl374_8 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_4764_output_and_/tdecoder.0/dconv/layers.1/layers.1.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_4764_output_and_/tdecoder.0/dconv/layers.1/layers.1.3/Conv /tdecoder.0/dconv/layers.1/layers.1.3/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tdecoder.0/dconv/layers.1/layers.1.3/Conv_output shuffle_after_/tdecoder.0/dconv/layers.1/layers.1.3/Conv_output Reformatting CopyNode for Input Tensor 0 to /decoder.0/conv_tr/ConvTranspose /decoder.0/conv_tr/ConvTranspose Reformatting CopyNode for Input Tensor 0 to PWN(PWN(PWN(PWN(PWN(PWN(/decoder.0/Constant_9_output_0 + ONNXTRT_Broadcast_4692, PWN(/decoder.0/Div)), PWN(/decoder.0/Erf)), /decoder.0/Constant_10_output_0 + ONNXTRT_Broadcast_4694 + /decoder.0/Add_1), PWN(/decoder.0/Mul_1)), /decoder.0/Constant_11_output_0 + ONNXTRT_Broadcast_4696 + /decoder.0/Mul_2), PWN(/decoder.1/Add)) PWN(PWN(PWN(PWN(PWN(PWN(/decoder.0/Constant_9_output_0 + ONNXTRT_Broadcast_4692, PWN(/decoder.0/Div)), PWN(/decoder.0/Erf)), /decoder.0/Constant_10_output_0 + ONNXTRT_Broadcast_4694 + /decoder.0/Add_1), PWN(/decoder.0/Mul_1)), /decoder.0/Constant_11_output_0 + ONNXTRT_Broadcast_4696 + /decoder.0/Mul_2), PWN(/decoder.1/Add)) Reformatting CopyNode for Input Tensor 0 to /decoder.1/rewrite/Conv /decoder.1/rewrite/Conv Reformatting CopyNode for Output Tensor 0 to /decoder.1/rewrite/Conv PWN(PWN(/decoder.1/Sigmoid), PWN(/decoder.1/Mul)) /decoder.1/Transpose + /decoder.1/Reshape Reformatting CopyNode for Output Tensor 0 to /decoder.1/Transpose + /decoder.1/Reshape Reformatting CopyNode for Input Tensor 0 to ONNXTRT_unsqueezeTensor_4830 ONNXTRT_unsqueezeTensor_4830 shuffle_between_ONNXTRT_unsqueezeTensor_4830_output_and_/decoder.1/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to /decoder.1/dconv/layers.0/layers.0.0/Conv /decoder.1/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/decoder.1/dconv/layers.0/layers.0.0/Conv_output shuffle_after_/decoder.1/dconv/layers.0/layers.0.0/Conv_output __myl_Move_myl397_0 __myl_ReshMean_myl397_1 __myl_Move_myl397_2 __myl_SubMulMean_myl397_3 __myl_AddSqrtDivMulAddReshMulAddSlicSigmSlicMulMulAdd_myl397_4 __myl_ReshMeanSubMulMeanAddSqrtDivMulAddReshMulAdd_myl397_5 __myl_DivErfAddMulMul_myl397_6 Reformatting CopyNode for Input Tensor 0 to /tdecoder.0/conv_tr/ConvTranspose /tdecoder.0/conv_tr/ConvTranspose Reformatting CopyNode for Input Tensor 0 to ONNXTRT_squeezeTensor_4785 ONNXTRT_squeezeTensor_4785 Reformatting CopyNode for Input Tensor 0 to PWN(PWN(PWN(PWN(PWN(PWN(/tdecoder.0/Constant_5_output_0 + ONNXTRT_Broadcast_4820, PWN(/tdecoder.0/Div)), PWN(/tdecoder.0/Erf)), PWN(/tdecoder.0/Constant_6_output_0 + ONNXTRT_Broadcast_4822, PWN(/tdecoder.0/Add_2))), PWN(/tdecoder.0/Mul_1)), PWN(/tdecoder.0/Constant_7_output_0 + ONNXTRT_Broadcast_4824, PWN(/tdecoder.0/Mul_2))), PWN(/tdecoder.1/Add)) PWN(PWN(PWN(PWN(PWN(PWN(/tdecoder.0/Constant_5_output_0 + ONNXTRT_Broadcast_4820, PWN(/tdecoder.0/Div)), PWN(/tdecoder.0/Erf)), PWN(/tdecoder.0/Constant_6_output_0 + ONNXTRT_Broadcast_4822, PWN(/tdecoder.0/Add_2))), PWN(/tdecoder.0/Mul_1)), PWN(/tdecoder.0/Constant_7_output_0 + ONNXTRT_Broadcast_4824, PWN(/tdecoder.0/Mul_2))), PWN(/tdecoder.1/Add)) ONNXTRT_unsqueezeTensor_4948 shuffle_between_ONNXTRT_unsqueezeTensor_4948_output_and_/tdecoder.1/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.1/rewrite/Conv /tdecoder.1/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tdecoder.1/rewrite/Conv_output shuffle_after_/tdecoder.1/rewrite/Conv_output ONNXTRT_squeezeTensor_4950 PWN(PWN(/tdecoder.1/Sigmoid), PWN(/tdecoder.1/Mul)) ONNXTRT_unsqueezeTensor_4955 shuffle_between_ONNXTRT_unsqueezeTensor_4955_output_and_/tdecoder.1/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.1/dconv/layers.0/layers.0.0/Conv /tdecoder.1/dconv/layers.0/layers.0.0/Conv shuffle_after_/tdecoder.1/dconv/layers.0/layers.0.0/Conv_output Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_4850_output_and_/decoder.1/dconv/layers.0/layers.0.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_4850_output_and_/decoder.1/dconv/layers.0/layers.0.3/Conv /decoder.1/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/decoder.1/dconv/layers.0/layers.0.3/Conv_output shuffle_after_/decoder.1/dconv/layers.0/layers.0.3/Conv_output Reformatting CopyNode for Input Tensor 0 to {ForeignNode[/tdecoder.1/dconv/layers.0/layers.0.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_4960...ONNXTRT_unsqueezeTensor_4869]} Reformatting CopyNode for Input Tensor 2 to {ForeignNode[/tdecoder.1/dconv/layers.0/layers.0.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_4960...ONNXTRT_unsqueezeTensor_4869]} __myl_Move_myl424_0 __myl_ReshCastMean_myl424_1 __myl_Move_myl424_2 __myl_SubMulAddSqrtDivMulCastAddReshMulAddMean_myl424_3 __myl_DivCastErfCastAddMulMul_myl424_4 __myl_Move_myl424_5 __myl_Move_myl424_6 __myl_ReshCastSubMulMeanMean_myl424_7 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAddResh_myl424_8 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_4975_output_and_/tdecoder.1/dconv/layers.0/layers.0.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_4975_output_and_/tdecoder.1/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.1/dconv/layers.0/layers.0.3/Conv /tdecoder.1/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tdecoder.1/dconv/layers.0/layers.0.3/Conv_output shuffle_after_/tdecoder.1/dconv/layers.0/layers.0.3/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_4869_output_and_/decoder.1/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to /decoder.1/dconv/layers.1/layers.1.0/Conv /decoder.1/dconv/layers.1/layers.1.0/Conv shuffle_after_/decoder.1/dconv/layers.1/layers.1.0/Conv_output Reformatting CopyNode for Input Tensor 2 to {ForeignNode[/tdecoder.1/dconv/layers.0/layers.0.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_4980...ONNXTRT_unsqueezeTensor_4889]} __myl_Move_myl436_0 __myl_ReshCastMean_myl436_1 __myl_Move_myl436_2 __myl_SubMulMean_myl436_3 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAddResh_myl436_4 __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastAddReshMulAdd_myl436_5 __myl_DivCastErfCastAddMulMul_myl436_6 shuffle_between_ONNXTRT_unsqueezeTensor_4994_output_and_/tdecoder.1/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.1/dconv/layers.1/layers.1.0/Conv /tdecoder.1/dconv/layers.1/layers.1.0/Conv shuffle_after_/tdecoder.1/dconv/layers.1/layers.1.0/Conv_output Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_4889_output_and_/decoder.1/dconv/layers.1/layers.1.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_4889_output_and_/decoder.1/dconv/layers.1/layers.1.3/Conv /decoder.1/dconv/layers.1/layers.1.3/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/decoder.1/dconv/layers.1/layers.1.3/Conv_output shuffle_after_/decoder.1/dconv/layers.1/layers.1.3/Conv_output Reformatting CopyNode for Input Tensor 0 to {ForeignNode[/tdecoder.1/dconv/layers.1/layers.1.1/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_4999.../decoder.1/Reshape_1 + /decoder.1/Transpose_1]} __myl_Move_myl447_0 __myl_ReshCastMean_myl447_1 __myl_Move_myl447_2 __myl_SubMulAddSqrtDivMulCastAddReshMulAddMean_myl447_3 __myl_DivCastErfCastAddMulMul_myl447_4 __myl_Move_myl447_5 __myl_Move_myl447_6 __myl_ReshCastSubMulMeanMean_myl447_7 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAddReshTran_myl447_8 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_5014_output_and_/tdecoder.1/dconv/layers.1/layers.1.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_5014_output_and_/tdecoder.1/dconv/layers.1/layers.1.3/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.1/dconv/layers.1/layers.1.3/Conv /tdecoder.1/dconv/layers.1/layers.1.3/Conv shuffle_after_/tdecoder.1/dconv/layers.1/layers.1.3/Conv_output Reformatting CopyNode for Input Tensor 0 to /decoder.1/conv_tr/ConvTranspose /decoder.1/conv_tr/ConvTranspose Reformatting CopyNode for Input Tensor 1 to PWN(PWN(PWN(PWN(PWN(PWN(/decoder.1/Constant_9_output_0 + ONNXTRT_Broadcast_4942, PWN(/decoder.1/Div)), PWN(/decoder.1/Erf)), /decoder.1/Constant_10_output_0 + ONNXTRT_Broadcast_4944 + /decoder.1/Add_1), PWN(/decoder.1/Mul_1)), /decoder.1/Constant_11_output_0 + ONNXTRT_Broadcast_4946 + /decoder.1/Mul_2), PWN(/decoder.2/Add)) PWN(PWN(PWN(PWN(PWN(PWN(/decoder.1/Constant_9_output_0 + ONNXTRT_Broadcast_4942, PWN(/decoder.1/Div)), PWN(/decoder.1/Erf)), /decoder.1/Constant_10_output_0 + ONNXTRT_Broadcast_4944 + /decoder.1/Add_1), PWN(/decoder.1/Mul_1)), /decoder.1/Constant_11_output_0 + ONNXTRT_Broadcast_4946 + /decoder.1/Mul_2), PWN(/decoder.2/Add)) /decoder.2/rewrite/Conv PWN(PWN(/decoder.2/Sigmoid), PWN(/decoder.2/Mul)) /decoder.2/Transpose + /decoder.2/Reshape Reformatting CopyNode for Output Tensor 0 to /decoder.2/Transpose + /decoder.2/Reshape ONNXTRT_unsqueezeTensor_5080 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_5080_output_and_/decoder.2/dconv/layers.0/layers.0.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_5080_output_and_/decoder.2/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to /decoder.2/dconv/layers.0/layers.0.0/Conv /decoder.2/dconv/layers.0/layers.0.0/Conv shuffle_after_/decoder.2/dconv/layers.0/layers.0.0/Conv_output Reformatting CopyNode for Input Tensor 1 to {ForeignNode[/tdecoder.1/dconv/layers.1/layers.1.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_5019...ONNXTRT_unsqueezeTensor_5100]} __myl_Move_myl468_0 __myl_ReshCastMean_myl468_1 __myl_Move_myl468_2 __myl_SubMulMean_myl468_3 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulCastAddResh_myl468_4 __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastAddReshMulAddDivCastErfCastAddMulMulResh_myl468_5 /tdecoder.1/conv_tr/ConvTranspose Reformatting CopyNode for Input Tensor 0 to ONNXTRT_squeezeTensor_5035 ONNXTRT_squeezeTensor_5035 PWN(PWN(PWN(PWN(PWN(PWN(/tdecoder.1/Constant_5_output_0 + ONNXTRT_Broadcast_5070, PWN(/tdecoder.1/Div)), PWN(/tdecoder.1/Erf)), PWN(/tdecoder.1/Constant_6_output_0 + ONNXTRT_Broadcast_5072, PWN(/tdecoder.1/Add_2))), PWN(/tdecoder.1/Mul_1)), PWN(/tdecoder.1/Constant_7_output_0 + ONNXTRT_Broadcast_5074, PWN(/tdecoder.1/Mul_2))), PWN(/tdecoder.2/Add)) ONNXTRT_unsqueezeTensor_5198 shuffle_between_ONNXTRT_unsqueezeTensor_5198_output_and_/tdecoder.2/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.2/rewrite/Conv /tdecoder.2/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tdecoder.2/rewrite/Conv_output shuffle_after_/tdecoder.2/rewrite/Conv_output ONNXTRT_squeezeTensor_5200 Reformatting CopyNode for Input Tensor 0 to PWN(PWN(/tdecoder.2/Sigmoid), PWN(/tdecoder.2/Mul)) Reformatting CopyNode for Input Tensor 1 to PWN(PWN(/tdecoder.2/Sigmoid), PWN(/tdecoder.2/Mul)) PWN(PWN(/tdecoder.2/Sigmoid), PWN(/tdecoder.2/Mul)) ONNXTRT_unsqueezeTensor_5205 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_5205_output_and_/tdecoder.2/dconv/layers.0/layers.0.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_5205_output_and_/tdecoder.2/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.2/dconv/layers.0/layers.0.0/Conv /tdecoder.2/dconv/layers.0/layers.0.0/Conv shuffle_after_/tdecoder.2/dconv/layers.0/layers.0.0/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_5100_output_and_/decoder.2/dconv/layers.0/layers.0.3/Conv /decoder.2/dconv/layers.0/layers.0.3/Conv shuffle_after_/decoder.2/dconv/layers.0/layers.0.3/Conv_output __myl_Move_myl492_0 __myl_ReshCastMean_myl492_1 __myl_Move_myl492_2 __myl_SubMulAddSqrtDivMulCastAddReshMulAddDivCastErfCastAddMulMulReshMean_myl492_3 __myl_Move_myl492_4 __myl_Move_myl492_5 __myl_ReshCastSubMulMeanMean_myl492_6 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulCastAddReshCast_myl492_7 shuffle_between_ONNXTRT_unsqueezeTensor_5225_output_and_/tdecoder.2/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.2/dconv/layers.0/layers.0.3/Conv /tdecoder.2/dconv/layers.0/layers.0.3/Conv shuffle_after_/tdecoder.2/dconv/layers.0/layers.0.3/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_5119_output_and_/decoder.2/dconv/layers.1/layers.1.0/Conv /decoder.2/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/decoder.2/dconv/layers.1/layers.1.0/Conv_output shuffle_after_/decoder.2/dconv/layers.1/layers.1.0/Conv_output __myl_Move_myl501_0 __myl_ReshMean_myl501_1 __myl_Move_myl501_2 __myl_SubMulMean_myl501_3 __myl_AddSqrtDivMulAddReshMulAddSlicSigmSlicMulMulAddResh_myl501_4 __myl_ReshMeanSubMulMeanAddSqrtDivMulAddReshMulAdd_myl501_5 __myl_DivErfAddMulMul_myl501_6 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_5244_output_and_/tdecoder.2/dconv/layers.1/layers.1.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_5244_output_and_/tdecoder.2/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.2/dconv/layers.1/layers.1.0/Conv /tdecoder.2/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tdecoder.2/dconv/layers.1/layers.1.0/Conv_output shuffle_after_/tdecoder.2/dconv/layers.1/layers.1.0/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_5139_output_and_/decoder.2/dconv/layers.1/layers.1.3/Conv /decoder.2/dconv/layers.1/layers.1.3/Conv shuffle_after_/decoder.2/dconv/layers.1/layers.1.3/Conv_output __myl_Move_myl511_0 __myl_ReshMean_myl511_1 __myl_Move_myl511_2 __myl_SubMulAddSqrtDivMulAddReshMulAddMean_myl511_3 __myl_DivErfAddMulMul_myl511_4 __myl_Move_myl511_5 __myl_Move_myl511_6 __myl_ReshSubMulMeanMean_myl511_7 __myl_AddSqrtDivMulAddReshMulAddSlicSigmSlicMulMulAddReshTran_myl511_8 shuffle_between_ONNXTRT_unsqueezeTensor_5264_output_and_/tdecoder.2/dconv/layers.1/layers.1.3/Conv /tdecoder.2/dconv/layers.1/layers.1.3/Conv shuffle_after_/tdecoder.2/dconv/layers.1/layers.1.3/Conv_output Reformatting CopyNode for Input Tensor 0 to /decoder.2/conv_tr/ConvTranspose /decoder.2/conv_tr/ConvTranspose Reformatting CopyNode for Input Tensor 1 to PWN(PWN(PWN(PWN(PWN(PWN(/decoder.2/Constant_9_output_0 + ONNXTRT_Broadcast_5192, PWN(/decoder.2/Div)), PWN(/decoder.2/Erf)), /decoder.2/Constant_10_output_0 + ONNXTRT_Broadcast_5194 + /decoder.2/Add_1), PWN(/decoder.2/Mul_1)), /decoder.2/Constant_11_output_0 + ONNXTRT_Broadcast_5196 + /decoder.2/Mul_2), PWN(/decoder.3/Add)) PWN(PWN(PWN(PWN(PWN(PWN(/decoder.2/Constant_9_output_0 + ONNXTRT_Broadcast_5192, PWN(/decoder.2/Div)), PWN(/decoder.2/Erf)), /decoder.2/Constant_10_output_0 + ONNXTRT_Broadcast_5194 + /decoder.2/Add_1), PWN(/decoder.2/Mul_1)), /decoder.2/Constant_11_output_0 + ONNXTRT_Broadcast_5196 + /decoder.2/Mul_2), PWN(/decoder.3/Add)) /decoder.3/rewrite/Conv Reformatting CopyNode for Output Tensor 0 to /decoder.3/rewrite/Conv PWN(PWN(/decoder.3/Sigmoid), PWN(/decoder.3/Mul)) Reformatting CopyNode for Input Tensor 0 to /decoder.3/Transpose + /decoder.3/Reshape /decoder.3/Transpose + /decoder.3/Reshape ONNXTRT_unsqueezeTensor_5330 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_5330_output_and_/decoder.3/dconv/layers.0/layers.0.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_5330_output_and_/decoder.3/dconv/layers.0/layers.0.0/Conv /decoder.3/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/decoder.3/dconv/layers.0/layers.0.0/Conv_output shuffle_after_/decoder.3/dconv/layers.0/layers.0.0/Conv_output entry^bb^signal^1_myl530_0 entry^bb^wait^1_myl530_1 __myl_Move_myl530_2 __myl_ReshMean_myl530_3 __myl_Move_myl530_4 __myl_SubMulMean_myl530_5 __myl_AddSqrtDivMulAddReshMulAddSlicSigmSlicMulMulAdd_myl530_6 __myl_ReshMeanSubMulMeanAddSqrtDivMulAddReshMulAdd_myl530_7 __myl_DivErfAddMulMul_myl530_8 exit^bb^signal^1_myl530_9 exit^bb^wait^1_myl530_10 Reformatting CopyNode for Input Tensor 0 to /tdecoder.2/conv_tr/ConvTranspose /tdecoder.2/conv_tr/ConvTranspose Reformatting CopyNode for Input Tensor 0 to ONNXTRT_squeezeTensor_5285 ONNXTRT_squeezeTensor_5285 PWN(PWN(PWN(PWN(PWN(PWN(/tdecoder.2/Constant_4_output_0 + ONNXTRT_Broadcast_5320, PWN(/tdecoder.2/Div)), PWN(/tdecoder.2/Erf)), PWN(/tdecoder.2/Constant_5_output_0 + ONNXTRT_Broadcast_5322, PWN(/tdecoder.2/Add_1))), PWN(/tdecoder.2/Mul_1)), PWN(/tdecoder.2/Constant_6_output_0 + ONNXTRT_Broadcast_5324, PWN(/tdecoder.2/Mul_2))), PWN(/tdecoder.3/Add)) ONNXTRT_unsqueezeTensor_5442 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_5442_output_and_/tdecoder.3/rewrite/Conv shuffle_between_ONNXTRT_unsqueezeTensor_5442_output_and_/tdecoder.3/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.3/rewrite/Conv /tdecoder.3/rewrite/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tdecoder.3/rewrite/Conv_output shuffle_after_/tdecoder.3/rewrite/Conv_output ONNXTRT_squeezeTensor_5444 PWN(PWN(/tdecoder.3/Sigmoid), PWN(/tdecoder.3/Mul)) ONNXTRT_unsqueezeTensor_5449 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_5449_output_and_/tdecoder.3/dconv/layers.0/layers.0.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_5449_output_and_/tdecoder.3/dconv/layers.0/layers.0.0/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.3/dconv/layers.0/layers.0.0/Conv /tdecoder.3/dconv/layers.0/layers.0.0/Conv shuffle_after_/tdecoder.3/dconv/layers.0/layers.0.0/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_5350_output_and_/decoder.3/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to /decoder.3/dconv/layers.0/layers.0.3/Conv /decoder.3/dconv/layers.0/layers.0.3/Conv shuffle_after_/decoder.3/dconv/layers.0/layers.0.3/Conv_output __myl_Move_myl555_0 __myl_ReshCastMean_myl555_1 __myl_Move_myl555_2 __myl_SubMulAddSqrtDivMulCastAddReshMulAddDivCastErfCastAddMulMulReshMean_myl555_3 __myl_ReshCastMeanSubMulMean_myl555_4 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulCastAddReshCast_myl555_5 shuffle_between_ONNXTRT_unsqueezeTensor_5469_output_and_/tdecoder.3/dconv/layers.0/layers.0.3/Conv /tdecoder.3/dconv/layers.0/layers.0.3/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tdecoder.3/dconv/layers.0/layers.0.3/Conv_output shuffle_after_/tdecoder.3/dconv/layers.0/layers.0.3/Conv_output shuffle_between_ONNXTRT_unsqueezeTensor_5369_output_and_/decoder.3/dconv/layers.1/layers.1.0/Conv /decoder.3/dconv/layers.1/layers.1.0/Conv shuffle_after_/decoder.3/dconv/layers.1/layers.1.0/Conv_output Reformatting CopyNode for Input Tensor 2 to {ForeignNode[/tdecoder.3/dconv/layers.0/layers.0.4/Constant_1_output_0 + ONNXTRT_unsqueezeTensor_5474...ONNXTRT_unsqueezeTensor_5389]} entry^bb^signal^1_myl564_0 entry^bb^wait^1_myl564_1 __myl_Move_myl564_2 __myl_ReshCastMean_myl564_3 __myl_Move_myl564_4 __myl_SubMulMean_myl564_5 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAddResh_myl564_6 __myl_ReshCastMeanSubMulMeanAddSqrtDivMulCastAddReshMulAdd_myl564_7 __myl_DivCastErfCastAddMulMul_myl564_8 exit^bb^signal^1_myl564_9 exit^bb^wait^1_myl564_10 Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_5488_output_and_/tdecoder.3/dconv/layers.1/layers.1.0/Conv shuffle_between_ONNXTRT_unsqueezeTensor_5488_output_and_/tdecoder.3/dconv/layers.1/layers.1.0/Conv Reformatting CopyNode for Input Tensor 0 to /tdecoder.3/dconv/layers.1/layers.1.0/Conv /tdecoder.3/dconv/layers.1/layers.1.0/Conv shuffle_after_/tdecoder.3/dconv/layers.1/layers.1.0/Conv_output Reformatting CopyNode for Input Tensor 0 to shuffle_between_ONNXTRT_unsqueezeTensor_5389_output_and_/decoder.3/dconv/layers.1/layers.1.3/Conv shuffle_between_ONNXTRT_unsqueezeTensor_5389_output_and_/decoder.3/dconv/layers.1/layers.1.3/Conv /decoder.3/dconv/layers.1/layers.1.3/Conv shuffle_after_/decoder.3/dconv/layers.1/layers.1.3/Conv_output __myl_Move_myl574_0 __myl_ReshCastMean_myl574_1 __myl_Move_myl574_2 __myl_SubMulAddSqrtDivMulCastAddReshMulAddDivCastErfCastAddMulMulReshMean_myl574_3 __myl_ReshCastMeanSubMulMean_myl574_4 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulCastAddReshTran_myl574_5 shuffle_between_ONNXTRT_unsqueezeTensor_5508_output_and_/tdecoder.3/dconv/layers.1/layers.1.3/Conv /tdecoder.3/dconv/layers.1/layers.1.3/Conv Reformatting CopyNode for Input Tensor 0 to shuffle_after_/tdecoder.3/dconv/layers.1/layers.1.3/Conv_output shuffle_after_/tdecoder.3/dconv/layers.1/layers.1.3/Conv_output /decoder.3/conv_tr/ConvTranspose Reformatting CopyNode for Input Tensor 4 to {ForeignNode[/Constant_111_output_0...ONNXTRT_unsqueezeTensor_5697]} __myl_Move_myl581_0 __myl_Move_myl581_1 __myl_ReshCastMean_myl581_2 __myl_Move_myl581_3 __myl_SubMulMean_myl581_4 __myl_AddSqrtDivMulCastAddReshMulAddSlicSigmSlicMulMulAdd_myl581_5 __myl_ReshReshSlicReshMulAdd_myl581_6 __myl_ReshTran_myl581_7 __myl_ReplReplConcReplReplConcReshSlicSlic_myl581_8 __mye14568_myl581_9 __mye14570_myl581_10 __myl_ReshReshGtrAddDivAtanMulMulAddSqrtLtAddAddSeleSeleSinMulCosMulConc_myl581_11 exit^bb^signal^1_myl581_12 exit^bb^wait^1_myl581_13 /ConstantOfShape_4_output_0 [empty tensor] Reformatting CopyNode for Input Tensor 0 to /tdecoder.3/conv_tr/ConvTranspose /tdecoder.3/conv_tr/ConvTranspose Reformatting CopyNode for Input Tensor 0 to ONNXTRT_squeezeTensor_5529 ONNXTRT_squeezeTensor_5529 /Reshape_16_copy_input /Reshape_16 /ConvTranspose Reformatting CopyNode for Input Tensor 0 to ONNXTRT_squeezeTensor_5699 ONNXTRT_squeezeTensor_5699 Reformatting CopyNode for Input Tensor 1 to PWN(/Mul_9) PWN(/Mul_9) /ConstantOfShape_4_output_0 copy /Squeeze_2 + /Reshape_15_copy_input /Squeeze_2 + /Reshape_15 /Slice_11 __myl_ReshReshMulAddAdd_myl598_0 Bindings: input output [02/18/2026-13:11:24] [I] Starting inference [02/18/2026-13:11:27] [I] Warmup completed 1 queries over 200 ms [02/18/2026-13:11:27] [I] Timing trace has 28 queries over 3.36833 s [02/18/2026-13:11:27] [I] [02/18/2026-13:11:27] [I] === Trace details === [02/18/2026-13:11:27] [I] Trace averages of 10 runs: [02/18/2026-13:11:27] [I] Average on 10 runs - GPU latency: 120.136 ms - Host latency: 121.621 ms (enqueue 66.3113 ms) [02/18/2026-13:11:27] [I] Average on 10 runs - GPU latency: 115.418 ms - Host latency: 116.907 ms (enqueue 69.3969 ms) [02/18/2026-13:11:27] [I] [02/18/2026-13:11:27] [I] === Performance summary === [02/18/2026-13:11:27] [I] Throughput: 8.31274 qps [02/18/2026-13:11:27] [I] Latency: min = 114.152 ms, max = 133.617 ms, mean = 120.21 ms, median = 117.238 ms, percentile(90%) = 131.085 ms, percentile(95%) = 131.515 ms, percentile(99%) = 133.617 ms [02/18/2026-13:11:27] [I] Enqueue Time: min = 11.5076 ms, max = 87.0873 ms, mean = 69.1293 ms, median = 68.7345 ms, percentile(90%) = 82.0427 ms, percentile(95%) = 82.4851 ms, percentile(99%) = 87.0873 ms [02/18/2026-13:11:27] [I] H2D Latency: min = 0.227295 ms, max = 0.229492 ms, mean = 0.227559 ms, median = 0.227539 ms, percentile(90%) = 0.227798 ms, percentile(95%) = 0.228027 ms, percentile(99%) = 0.229492 ms [02/18/2026-13:11:27] [I] GPU Compute Time: min = 112.668 ms, max = 132.132 ms, mean = 118.724 ms, median = 115.753 ms, percentile(90%) = 129.601 ms, percentile(95%) = 130.03 ms, percentile(99%) = 132.132 ms [02/18/2026-13:11:27] [I] D2H Latency: min = 1.25732 ms, max = 1.27905 ms, mean = 1.25867 ms, median = 1.25745 ms, percentile(90%) = 1.2583 ms, percentile(95%) = 1.2688 ms, percentile(99%) = 1.27905 ms [02/18/2026-13:11:27] [I] Total Host Walltime: 3.36833 s [02/18/2026-13:11:27] [I] Total GPU Compute Time: 3.32427 s [02/18/2026-13:11:27] [W] * GPU compute time is unstable, with coefficient of variance = 5.19667%. [02/18/2026-13:11:27] [W] If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability. [02/18/2026-13:11:27] [I] Explanations of the performance metrics are printed in the verbose logs. [02/18/2026-13:11:27] [I] &&&& PASSED TensorRT.trtexec [TensorRT v101501] [b29] # C:\Program Files\NVIDIA GPU Computing Toolkit\TensorRT-10.15.1.29\bin\trtexec.exe --loadEngine=demucsv4_sm86_trt10.15.trt --dumpLayerInfo (2026) PS A:\Projects\Demucs_v4_TRT\models>