gabehf
/
Tdarr_Plugins
mirror of https://github.com/gabehf/Tdarr_Plugins.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '93bc0c3a93'
${ noResults }
Tdarr_Plugins/Community/Tdarr_Plugin_JB69_JBHEVCQSV...

857 lines
37 KiB
Raw Blame History Escape

// allow isNaN
/* eslint no-restricted-globals: 0 */
/* eslint no-template-curly-in-string: 0 */
/* eslint global-require: 0 */
/* eslint eqeqeq: 1 */
/*
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
Author: JarBinks, Zachg99, Jeff47
Date: 12/26/2021
This is my attempt to create an all in one routine that will maintain my library in optimal format
!!!!FOR MY REQUIREMENTS!!!! Chances are very good you will need to make some changes to this routine
and it's partner in order to make it work for you.
Chances are also very good you will need to run linux commands and learn about ffmpeg, vaapi, Tdarr
and this script.
With that out of the way...Tdarr is awesome because it allowed me to create data driven code that
makes my library the best it could be. Thanks to everyone involved. Especially HaveAGitGat and Migz
whos existing code and assistance were invaluable
My belief is that given enough information about the video file an optimal configuration can be determined
specific to that file
This is based on what my goals are and uses external programs to gather as much useful information as possible
to make decisions.
There is a lot that goes into the gather and analysis part because:
It is the basis of the decisions and "garbage in, garbage out"
The video files are far from perfect when we get them and we need to make sure we learn as much as possible
The script adds metatags to the media files to control processing, or better yet not doing extra processing
on the same file.
This is especially useful when resetting Tdarr because each file gets touched again, so this expedites a full
library scan.
Tdarr does not seem to handle when a plugin code takes a while to run so all effort has been made minimize time
within the plugin code.
This is especially noticeable on a library reset and these scripts because of the extra time spent analyzing the
media files
Video: (Only one video stream is used!!)
The script computes a desired bitrate based on the following equation
(videoheight * videowidth * videoFPS) * targetcodeccompression
The first 3 give a raw number of bits that the stream requires, however with encoding there is a certain amount
of acceptable loss, this is targetcodeccompression
This number is pretty low for hevc. I have found 0.07 to be about the norm.
This means that for hevc only 7% of the raw bitrate is necessary to produce some decent results and actually I
have used, and seen, as low as 3.5%
If the source video is less than this rate the script will either:
Copy the existing stream, if the codec is hevc
Transcode the stream to hevc using 80% of the original streams bitrate
It could probably be less but if the source is of low bitrate we don<6F>t want to compromise too much on
the transcode
If the source media bitrate is close, within 10%, of the target bitrate and the codec is hevc, it will copy
instead of transcode to preserve quality
The script will do an on chip transcode, meaning the decode and encode is all done on chip, except for mpeg4
which must be decoded on the CPU
(TODO: Videos with a framerate higher than a threshold, lets say 30, should be changed)
Audio: (Only one audio stream is used!!)
The script will choose one audio stream in the file that has:
The desired language
The highest channel count
If the language is not set on the audio track it assumes it is in the desired language
The audio bit rate is set to a threshold, currently 64K, * number channels in AAC. This
seems to give decent results
If the source audio is less than this rate the script will either:
Copy the existing stream, if the codec is aac
Transcode the stream to aac using 100% of the original streams bitrate
It could probably be less but if the source is of low bitrate but, we don<6F>t want
to compromise too much on the transcode
Subtitles:
All are removed?? (TODO: ensure this is correct and mention the flag to keep them if desired)
All are copied (They usually take up little space so I keep them)
Any that are in mov_text will be converted to srt
Chapters:
If chapters are found the script keeps them unless...
Any chapter start time is a negative number (Yes I have seen it)
Any duplicate start times are found
(TODO: incomplete chapter info gets added to or removed...I have seen 2 chapters in the beginning and
then nothing)
The second routine will add chapters at set intervals to any file that has no chapters
Metadata:
Global metadata is cleared, I.E. title
Stream specific metadata is copied
Some requirements: (You should really really really really read this!!!)
! !!!! Docker on linux !!!!!
Intel QSV compatible processor, I run it on an i5-9400 and I know earlier models have no
HEVC capability or produce lessor results
First off the Matching pair:
Tdarr_Plugin_JB69_JBHEVCQSV_MinimalFile (JB - QSV(vaapi), H265, AAC, MKV, bitrate optimized)
Tdarr_Plugin_JB69_JBHEVCQSZ_PostFix (JB - MKV Stats, Chapters, Audio Language)
The order I run them in:
Tdarr_Plugin_JB69_JBHEVCQSV_MinimalFile (JB - H265, AAC, MKV, bitrate optimized)
Tdarr_Plugin_JB69_JBHEVCQSZ_PostFix (JB - MKV Stats, Chapters, Audio Language)
I am running the docker image provided for Tdarr
Here is my docker config (I am running compose so yours might be a little different)
tdarr_server:
container_name: tdarr_server
image: haveagitgat/tdarr:latest
privileged: true
restart: unless-stopped
environment:
- PUID=${PUID} # default user id, defined in .env
- PGID=${PGID} # default group id, defined in .env
- TZ=${TZ} # timezone, defined in .env
- serverIP=tdarr_server #using internal docker networking. This should at least work when the nodes are on
#the same docker compose as the server
- serverPort=8266
- webUIPort=8265
volumes:
- ${ROOT}/tdarr/server:/app/server/Tdarr # Tdarr server files
- ${ROOT}/tdarr/configs:/app/configs # config files - can be same as NODE (unless separate server)
- ${ROOT}/tdarr/logs:/app/logs # Tdarr log files
- ${ROOT}/tdarr/cache:/temp # Cache folder, Should be same path mapped on NODE
- ${ROOT}/tdarr/testmedia:/home/Tdarr/testmedia # Should be same path mapped on NODE if using a test folder
- ${ROOT}/tdarr/scripts:/home/Tdarr/scripts # my random way of saving script files
- /volume1/video:/media # video library Should be same path mapped on NODE
ports:
- 8265:8265 #Exposed to access webui externally
- 8266:8266 #Exposed to allow external nodes to reach the server
logging:
options:
max-size: "2m"
max-file: "3"
tdarr_node:
container_name: tdarr_node
image: haveagitgat/tdarr_node:latest
privileged: true
restart: unless-stopped
devices:
- /dev/dri:/dev/dri
environment:
- PUID=${PUID} # default user id, defined in .env
- PGID=${PGID} # default group id, defined in .env
- TZ=${TZ} # timezone, defined in .env
- serverIP=192.168.x.x #container name of the server, should be modified if server is on another machine
- serverPort=8266
- nodeID=TDARRNODE_2
- nodeIP=192.168.x.x #container name of the node
- nodePort=9267 #not exposed via a "ports: " setting as the server/node communication is done on the internal
#docker network and can communicate on all ports
volumes:
- ${ROOT}/tdarr/configs:/app/configs # config files - can be same as server (unless separate server)
- ${ROOT}/tdarr/logs:/app/logs # config files - can be same as server (unless separate server)
- ${ROOT}/tdarr/testmedia:/home/Tdarr/testmedia # Should be same path mapped on server if using a test folder
- ${ROOT}/tdarr/scripts:/home/Tdarr/scripts # my random way of saving script files
- ${ROOT}/tdarr/cache:/temp # Cache folder, Should be same path mapped on server
- /mnt/video:/media # video library Should be same path mapped on server
ports:
- 9267:9267
logging:
options:
max-size: "2m"
max-file: "3"
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
*/
const details = () => ({
id: 'Tdarr_Plugin_JB69_JBHEVCQSV_MinimalFile',
Stage: 'Pre-processing',
Name: 'JB - QSV(vaapi), H265, AAC, MKV, bitrate optimized',
Type: 'Video',
Operation: 'Transcode',
Description: `***You should not use this*** until you read the comments at the top of the code and understand
how it works **this does alot** and is 1 of 2 routines you should to run **Part 1** \n`,
Version: '2.1',
Tags: 'pre-processing,ffmpeg,video,audio,qsv h265,aac',
Inputs: [],
});
function findMediaInfoItem(file, index) {
let currMIOrder = -1;
const strstreamType = file.ffProbeData.streams[index].codec_type.toLowerCase();
for (let i = 0; i < file.mediaInfo.track.length; i += 1) {
if (file.mediaInfo.track[i].StreamOrder) {
currMIOrder = file.mediaInfo.track[i].StreamOrder;
} else if (strstreamType === 'text' || strstreamType === 'subtitle') {
currMIOrder = file.mediaInfo.track[i].ID - 1;
} else {
currMIOrder = -1;
}
if (parseInt(currMIOrder, 10) === parseInt(index, 10) || currMIOrder === `0-${index}`) {
return i;
}
}
return -1;
}
// eslint-disable-next-line no-unused-vars
const plugin = (file, librarySettings, inputs, otherArguments) => {
// eslint-disable-next-line global-require
const lib = require('../methods/lib')();
// eslint-disable-next-line no-unused-vars,no-param-reassign
inputs = lib.loadDefaultValues(inputs, details);
const response = {
processFile: false,
preset: '',
container: '.mkv',
handBrakeMode: false,
FFmpegMode: true,
reQueueAfter: true,
infoLog: '',
};
const currentfilename = file._id; // .replace(/'/g, "'\"'\"'");
// Settings
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
// Process Handling
const intStatsDays = 21; // If the stats date on the file, usually for mkv only,
// are older than this it will first update them
// Video
const targetvideocodec = 'hevc'; // This is the basis of the routine, if you want to change
// it you probably want to use a different script
const boluse10bit = true; // This will encode in 10 bit
const targetframerate = 25; // Any frame rate greater than this will be adjusted
const minsizedifffortranscode = 1.2; // If the existing bitrate is this much more than the target
// bitrate it is ok to transcode, otherwise there might not be enough extra
// to get decent quality
const targetreductionforcodecswitchonly = 0.8; // When a video codec change happens and the source bitrate is lower
// than optimal, we still lower the bitrate by this since hevc is ok
// with a lower rate
const maxvideoheight = 2160; // Any thing over this size, I.E. 8K, will be reduced to this
const targetcodeccompression = 0.08; // This effects the target bitrate by assuming a compression ratio
// Since videos can have many widths and heights we need to convert to pixels (WxH) to understand what we
// are dealing with and set a minimal optimal bitrate to not go below
const minvideopixels4K = 6500000;
const minvideorate4K = 8500000;
const minvideopixels2K = 1500000;
const minvideorate2K = 2400000;
const minvideopixelsHD = 750000;
const minvideorateHD = 1100000;
const minvideorateSD = 450000;
// Audio
const targetaudiocodec = 'aac'; // Desired Audio Coded, if you change this it will might require code changes
const targetaudiolanguage = 'eng'; // Desired Audio Language
const targetaudiobitrateperchannel = 64000; // 64K per channel gives you the good lossy quality out of AAC
const targetaudiochannels = 6; // Any thing above this number of channels will be
// reduced to it, because I cannot listen to it
// Subtitles
// const bolIncludeSubs = true; //not used
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
const proc = require('child_process'); // Causes lint error, hopefully not needed
let bolStatsAreCurrent = false;
// Run MediaInfo and load the results it into an object
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
// response.infoLog += "Getting Media Info.\n";
// var objMedInfo = "";
// objMedInfo = JSON.parse(proc.execSync('mediainfo "' + currentfilename + '" --output=JSON').toString());
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
// Run ffprobe with full info and load the results it into an object
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
// response.infoLog += "Getting FFProbe Info.\n";
// var objFFProbeInfo = "";
// objFFProbeInfo = JSON.parse(proc.execSync('ffprobe -v error -print_format json
// -show_format -show_streams -show_chapters "' + currentfilename + '"').toString());
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
// response.processFile = false;
// response.infoLog += objMedInfo + " \n";
// return response;
// response.infoLog += "HomePath:" + JSON.stringify(otherArguments, null, 4) + "\n";
// response.infoLog += "FIID:" + file._id + "\n";
// response.infoLog += "IPID:" + inputs._id + "\n";
// response.infoLog += "FIDB:" + JSON.stringify(file, null, 4) + "\n";
// response.infoLog += "CacheDir:" + librarySettings.cache + "\n";
// response.infoLog += "filename:" + require("crypto").createHash("md5").update(file._id).digest("hex") + "\n";
// response.infoLog += "MediaInfo:" + JSON.stringify(objMedInfo, null, 4) + "\n";
// response.infoLog += "FFProbeInfo:" + JSON.stringify(objFFProbeInfo, null, 4) + "\n";
// response.infoLog += "objFFProbeInfo:" + JSON.stringify(objFFProbeInfo, null, 4) + "\n";
// response.processFile = false;
// return response;
// Check if file is a video. If it isn't then exit plugin.
if (file.fileMedium !== 'video') {
response.processFile = false;
response.infoLog += 'File is not a video. Exiting \n';
return response;
}
// If the file has already been processed we dont need to do more
if (file.container === 'mkv' && (
file.mediaInfo.track[0].extra !== undefined
&& file.mediaInfo.track[0].extra.JBDONEVERSION !== undefined
&& file.mediaInfo.track[0].extra.JBDONEVERSION === '1')
) {
response.processFile = false;
response.infoLog += 'File already Processed! \n';
return response;
}
// If the existing container is mkv there is a possibility the stats were not updated during any previous transcode,
// lets make sure
if (file.container === 'mkv') {
let datStats = Date.parse(new Date(70, 1).toISOString());
if (
file.ffProbeData.streams[0].tags !== undefined
&& file.ffProbeData.streams[0].tags['_STATISTICS_WRITING_DATE_UTC-eng'] !== undefined
) {
datStats = Date.parse(`${file.ffProbeData.streams[0].tags['_STATISTICS_WRITING_DATE_UTC-eng']} GMT`);
}
if (file.mediaInfo.track[0].extra !== undefined && file.mediaInfo.track[0].extra.JBDONEDATE !== undefined) {
const JBDate = Date.parse(file.mediaInfo.track[0].extra.JBDONEDATE);
response.infoLog += `JBDate: ${JBDate}, StatsDate: ${datStats}\n`;
if (datStats >= JBDate) {
bolStatsAreCurrent = true;
}
} else {
const statsThres = Date.parse(new Date(new Date().setDate(new Date().getDate() - intStatsDays)).toISOString());
response.infoLog += `StatsThres: ${statsThres}, StatsDate: ${datStats}\n`;
if (datStats >= statsThres) {
bolStatsAreCurrent = true;
}
}
if (!bolStatsAreCurrent) {
response.infoLog += 'Stats need to be updated! \n';
try {
proc.execSync(`mkvpropedit --add-track-statistics-tags "${currentfilename}"`);
} catch (err) {
response.infoLog += 'Error Updating Status Probably Bad file, A remux will probably fix, will continue\n';
}
response.infoLog += 'Getting Stats Objects, again!\n';
// objMedInfo = JSON.parse(proc.execSync('mediainfo "' + currentfilename + '" --output=JSON').toString());
// objFFProbeInfo = JSON.parse(proc.execSync('ffprobe -v error -print_format json' +
// ' -show_format -show_streams -show_chapters "' + currentfilename + '"').toString());
}
}
// Logic Controls
let bolscaleVideo = false;
let boltranscodeVideo = false;
let bolchangeframerateVideo = false;
let optimalvideobitrate = 0;
let videonewwidth = 0;
let bolSource10bit = false;
let boltranscodeSoftwareDecode = false;
let audionewchannels = 0;
let boltranscodeAudio = false;
let boldownmixAudio = false;
let audioChannels = 0;
let audioBitrate = 0;
let audioIdxChannels = 0;
let audioIdxBitrate = 0;
let boldosubs = false;
let bolforcenosubs = false;
let boldosubsconvert = false;
const boldochapters = true;
// Set up required variables
let videoIdx = -1;
let videoIdxFirst = -1;
let audioIdx = -1;
let audioIdxOther = -1;
let strstreamType = '';
let MILoc = -1;
// Go through each stream in the file.
for (let i = 0; i < file.ffProbeData.streams.length; i += 1) {
strstreamType = file.ffProbeData.streams[i].codec_type.toLowerCase();
// Looking For Video
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
if (strstreamType === 'video') {
// First we need to check if it is included in the MediaInfo struture, it might not be (mjpeg??, others??)
MILoc = findMediaInfoItem(file, i);
response.infoLog += `Index ${i} MediaInfo stream: ${MILoc} \n`;
if (MILoc > -1) {
const streamheight = file.ffProbeData.streams[i].height * 1;
const streamwidth = file.ffProbeData.streams[i].width * 1;
const streamFPS = file.mediaInfo.track[MILoc].FrameRate * 1;
let streamBR = file.mediaInfo.track[MILoc].BitRate * 1;
if (isNaN(streamBR)) {
streamBR = file.mediaInfo.track[MILoc].extra.FromStats_BitRate * 1;
}
response.infoLog
+= `Video stream ${i}:${Math.floor(file.meta.Duration / 60)}:`
+ `${file.ffProbeData.streams[i].codec_name}${(bolSource10bit) ? '(10)' : ''}`;
response.infoLog += `:${streamwidth}x${streamheight}x${streamFPS}:${streamBR}bps \n`;
if (videoIdxFirst === -1) {
videoIdxFirst = i;
}
if (videoIdx === -1) {
videoIdx = i;
} else {
const MILocC = findMediaInfoItem(file, videoIdx);
// const curstreamheight = file.ffProbeData.streams[videoIdx].height * 1; //Not needed
const curstreamwidth = file.ffProbeData.streams[videoIdx].width * 1;
// const curstreamFPS = file.mediaInfo.track[MILocC].FrameRate * 1; //Not needed
let curstreamBR = file.mediaInfo.track[MILocC].BitRate * 1;
if (isNaN(curstreamBR)) {
curstreamBR = file.mediaInfo.track[MILocC].extra.FromStats_BitRate * 1;
}
// Only check here based on bitrate and video width
if (streamBR > curstreamBR && streamwidth >= curstreamwidth) {
videoIdx = i;
}
}
}
}
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
// Looking For Audio
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
if (strstreamType === 'audio') {
// response.processFile = false;
// response.infoLog += i + ":" + objFFProbeInfo.streams[i].tags.language + " \n";
// audioIdxFirst = i;
// response.infoLog += JSON.stringify(objFFProbeInfo.streams[i]) + " \n";
audioChannels = file.ffProbeData.streams[i].channels * 1;
audioBitrate = file.mediaInfo.track[findMediaInfoItem(file, i)].BitRate * 1;
if (isNaN(audioBitrate)) {
audioBitrate = file.mediaInfo.track[findMediaInfoItem(file, i)].extra.FromStats_BitRate * 1;
}
if (
file.ffProbeData.streams[i].tags !== undefined
&& file.ffProbeData.streams[i].tags.language === targetaudiolanguage
) {
response.infoLog
+= `Audio stream ${i}:${targetaudiolanguage}`
+ `:${file.ffProbeData.streams[i].codec_name}:${audioChannels}:${audioBitrate}bps:`;
if (audioIdx === -1) {
response.infoLog += 'First Audio Stream \n';
audioIdx = i;
} else {
audioIdxChannels = file.ffProbeData.streams[audioIdx].channels * 1;
audioIdxBitrate = file.mediaInfo.track[findMediaInfoItem(file, audioIdx)].BitRate;
if (audioChannels > audioIdxChannels) {
response.infoLog += 'More Audio Channels \n';
audioIdx = i;
} else if (audioChannels === audioIdxChannels && audioBitrate > audioIdxBitrate) {
response.infoLog += 'Higher Audio Rate \n';
audioIdx = i;
}
}
} else {
response.infoLog += `Audio stream ${i}:???:${file.ffProbeData.streams[i].codec_name}`
+ `:${audioChannels}:${audioBitrate}bps:`;
if (audioIdxOther === -1) {
response.infoLog += 'First Audio Stream \n';
audioIdxOther = i;
} else {
audioIdxChannels = file.ffProbeData.streams[audioIdxOther].channels * 1;
audioIdxBitrate = file.mediaInfo.track[findMediaInfoItem(file, audioIdxOther)].BitRate;
if (audioChannels > audioIdxChannels) {
response.infoLog += 'More Audio Channels \n';
audioIdxOther = i;
} else if (audioChannels === audioIdxChannels && audioBitrate > audioIdxBitrate) {
response.infoLog += 'Higher Audio Rate \n';
audioIdxOther = i;
}
}
}
}
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
// Looking For Subtitles -- These are causing problems let's just exclude for now
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
if (!bolforcenosubs && !boldosubs && (strstreamType === 'text' || strstreamType === 'subtitle')) {
// A sub has an S_TEXT/WEBVTT codec, ffmpeg will fail with it
if (file.mediaInfo.track[findMediaInfoItem(file, i)].CodecID !== 'S_TEXT/WEBVTT') {
boldosubs = true;
if (file.ffProbeData.streams[i].codec_name === 'mov_text') {
boldosubsconvert = true;
response.infoLog += 'SubTitles Found (mov_text), will convert \n';
} else {
response.infoLog += 'SubTitles Found, will copy \n';
}
} else {
response.infoLog += 'SubTitles Found (S_TEXT/WEBVTT), will not copy \n';
bolforcenosubs = true;
}
}
// boldosubs = true;
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
}
// return response;
// Go through chapters in the file looking for badness
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
// Not processing chapters - fileobject doesn't seem to have the chapters section
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
// for (var i = 0; i < objFFProbeInfo.chapters.length; i+=1) {
// Bad start times
// if (objFFProbeInfo.chapters[i].start_time < 0) {
// boldochapters = false;
// break; //Dont need to continue because we know they are bad
// }
// Duplicate start times
// for (var x = 0; i < objFFProbeInfo.chapters.length; i+=1) {
// if (i != x && objFFProbeInfo.chapters[i].start_time == objFFProbeInfo.chapters[x].start_time) {
// boldochapters = false;
// break; //Dont need to continue because we know they are bad
// }
// }
// }
// Video Decision section
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
if (videoIdx === -1) {
response.processFile = false;
response.infoLog += 'No Video Track !! \n';
return response;
}
boltranscodeVideo = true; // We will assume we will be transcoding
MILoc = findMediaInfoItem(file, videoIdx);
let videoheight = file.ffProbeData.streams[videoIdx].height * 1;
let videowidth = file.ffProbeData.streams[videoIdx].width * 1;
let videoFPS = file.mediaInfo.track[MILoc].FrameRate * 1;
let videoBR = file.mediaInfo.track[MILoc].BitRate * 1;
if (isNaN(videoBR)) {
videoBR = file.mediaInfo.track[MILoc].extra.FromStats_BitRate * 1;
}
if (
file.ffProbeData.streams[videoIdx].profile !== undefined
&& file.ffProbeData.streams[videoIdx].profile.includes !== undefined
&& file.ffProbeData.streams[videoIdx].profile.includes('10')) {
bolSource10bit = true;
}
// Source is Variable Frame rate but we will transcode to fixed
if (file.mediaInfo.track[MILoc].FrameRate_Mode === 'VFR') videoFPS = 9999;
if (videoFPS > targetframerate) {
bolchangeframerateVideo = true; // Need to fix this it does not work :-(
}
// Lets see if we need to scal down the video size
if (videoheight > maxvideoheight) {
bolscaleVideo = true;
videonewwidth = Math.floor((maxvideoheight / videoheight) * videowidth);
response.infoLog
+= `Video Resolution, ${videowidth}x${videoheight}, need to convert to ${videonewwidth}x${maxvideoheight} \n`;
videoheight = maxvideoheight;
videowidth = videonewwidth;
}
// Figure out the desired bitrate
optimalvideobitrate = Math.floor((videoheight * videowidth * targetframerate) * targetcodeccompression);
response.infoLog += `Pre Video Calc: ${videoheight}, ${videowidth}, ${videoFPS}, ${optimalvideobitrate} \n`;
// We need to check for a minimum bitrate
if ((videoheight * videowidth) > minvideopixels4K && optimalvideobitrate < minvideopixels4K) {
response.infoLog
+= `Video Bitrate calulcated for 4K, ${optimalvideobitrate}, is below minimum, ${minvideopixels4K} \n`;
optimalvideobitrate = minvideorate4K;
} else if ((videoheight * videowidth) > minvideopixels2K && optimalvideobitrate < minvideorate2K) {
response.infoLog
+= `Video Bitrate calulcated for 2K, ${optimalvideobitrate}, is below minimum, ${minvideorate2K} \n`;
optimalvideobitrate = minvideorate2K;
} else if ((videoheight * videowidth) > minvideopixelsHD && optimalvideobitrate < minvideorateHD) {
response.infoLog
+= `Video Bitrate calulcated for HD, ${optimalvideobitrate}, is below minimum, ${minvideorateHD} \n`;
optimalvideobitrate = minvideorateHD;
} else if (optimalvideobitrate < minvideorateSD) {
response.infoLog
+= `Video Bitrate calulcated for SD, ${optimalvideobitrate}, is below minimum, ${minvideorateSD} \n`;
optimalvideobitrate = minvideorateSD;
}
// Check if it is already hvec, if not then we must transcode
if (file.ffProbeData.streams[videoIdx].codec_name !== targetvideocodec) {
response.infoLog
+= `Video existing Codex is ${file.ffProbeData.streams[videoIdx].codec_name}${(bolSource10bit) ? '(10)' : ''}`;
response.infoLog += `, need to convert to ${targetvideocodec}${(boluse10bit) ? '(10)' : ''} \n`;
if (file.ffProbeData.streams[videoIdx].codec_name === 'mpeg4') {
boltranscodeSoftwareDecode = true;
response.infoLog
+= `Video existing Codex is ${file.ffProbeData.streams[videoIdx].codec_name}, `
+ 'need to decode with software codec \n';
} else if (
file.ffProbeData.streams[videoIdx].codec_name === 'h264'
&& file.ffProbeData.streams[videoIdx].profile.includes('10')
) {
// If the source is 10 bit then we must software decode since qsv will not decode 264 10 bit??
boltranscodeSoftwareDecode = true;
response.infoLog
+= `Video existing Codex is ${file.ffProbeData.streams[videoIdx].codec_name} 10 bit,`
+ ' need to decode with software codec \n';
}
}
if (videoBR < (optimalvideobitrate * minsizedifffortranscode)) {
// We need to be careful here are else we could produce a bad quality
response.infoLog += 'Low source bitrate! \n';
if (file.ffProbeData.streams[videoIdx].codec_name === targetvideocodec) {
if (bolSource10bit === boluse10bit) {
response.infoLog
+= `Video existing Bitrate, ${videoBR}, is close to target Bitrate, `
+ `${optimalvideobitrate}, using existing stream \n`;
boltranscodeVideo = false;
} else {
response.infoLog
+= 'Video existing bit depth is different from target, without a codec change, using using existing bitrate \n';
optimalvideobitrate = videoBR;
}
} else {
// We have a codec change with not much meat so we need to adjust are target rate
response.infoLog += `Video existing Bitrate, ${videoBR}, is close to, or lower than, target Bitrate, `;
response.infoLog
+= `${optimalvideobitrate}, with a codec change, using ${Math.floor(targetreductionforcodecswitchonly * 100)}`
+ '% of existing \n';
optimalvideobitrate = Math.floor(videoBR * targetreductionforcodecswitchonly);
boltranscodeVideo = true;
}
} else {
// We already know the existing bitrate has enough meat for a decent transcode
// boltranscodeVideo = true;
response.infoLog += `Video existing Bitrate, ${videoBR}, is higher than target,`
+ ` ${optimalvideobitrate}, transcoding \n`;
}
response.infoLog += `Post Video Calc: ${videoheight}, ${videowidth}, ${videoFPS}, ${optimalvideobitrate} \n`;
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
// Audio Decision section
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
if (audioIdx === -1) {
if (audioIdxOther !== -1) {
response.infoLog += 'Using Unknown Audio Track !! \n';
audioIdx = audioIdxOther;
} else {
response.processFile = false;
response.infoLog += 'No Audio Track !! \n';
return response;
}
}
let audioBR = file.mediaInfo.track[findMediaInfoItem(file, audioIdx)].BitRate * 1;
if (isNaN(audioBR)) {
audioBR = file.mediaInfo.track[findMediaInfoItem(file, audioIdx)].extra.FromStats_BitRate * 1;
}
if (file.ffProbeData.streams[audioIdx].channels > targetaudiochannels) {
boldownmixAudio = true;
audionewchannels = targetaudiochannels;
response.infoLog
+= `Audio existing Channels, ${file.ffProbeData.streams[audioIdx].channels}, `
+ `is higher than target, ${targetaudiochannels} \n`;
} else {
audionewchannels = file.ffProbeData.streams[audioIdx].channels;
}
let optimalaudiobitrate = audionewchannels * targetaudiobitrateperchannel;
// Now what are we going todo with the audio part
if (audioBR > (optimalaudiobitrate * 1.1)) {
boltranscodeAudio = true;
response.infoLog += `Audio existing Bitrate, ${audioBR}, is higher than target, ${optimalaudiobitrate} \n`;
}
// If the audio codec is not what we want then we should transcode
if (file.ffProbeData.streams[audioIdx].codec_name !== targetaudiocodec) {
boltranscodeAudio = true;
response.infoLog
+= `Audio Codec, ${file.ffProbeData.streams[audioIdx].codec_name}, is different than target, `
+ `${targetaudiocodec}, Changing \n`;
}
// If the source bitrate is less than out target bitrate we should not ever go up
if (audioBR < optimalaudiobitrate) {
response.infoLog += `Audio existing Bitrate, ${audioBR}, is lower than target,`
+ ` ${optimalaudiobitrate}, using existing `;
optimalaudiobitrate = audioBR;
if (file.ffProbeData.streams[audioIdx].codec_name !== targetaudiocodec) {
response.infoLog += 'rate';
} else {
response.infoLog += 'stream';
}
response.infoLog += ' \n';
}
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
// lets assemble our ffmpeg command
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
const strtrancodebasehw = ' -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi ';
const strtrancodebasesw = ' -vaapi_device /dev/dri/renderD128 ';
const strtranscodevideomapping = ' <io> -max_muxing_queue_size 8000 -map 0:{0} ';
const strtranscodevideocopy = ' -c:v:0 copy ';
const strtranscodevideotranscoding = ' -c:v:0 hevc_vaapi ';
// Used to make the output 10bit, I think the quotes need to be this way for ffmpeg
const strtranscodevideooptions = ' -vf "{0}" ';
const strtranscodevideoscaling = 'w=-1:h=1080'; // Used when video is above our target of 1080
const strtranscodeframerate = 'fps={0}'; // Used to change the framerate to the target framerate
const strtranscodevideoformathw = 'scale_vaapi='; // Used to make the output 10bit
const strtranscodevideoformat = 'format={0}'; // Used to add filters to the hardware transcode
const strtranscodevideo10bit = 'p010'; // Used to make the output 10bit
const strtranscodevideo8bit = 'p008'; // Used to make the output 8bit
const strtranscodevideoswdecode = 'hwupload'; // Used to make it use software decode if necessary
// Used to make it sure the software decode is in the proper pixel format
const strtranscodevideoswdecode10bit = 'nv12|vaapi';
const strtranscodevideobitrate = ' -b:v {0} '; // Used when video is above our target of 1080
const strtranscodeaudiomapping = ' -map 0:{0} ';
const strtranscodeaudiocopy = ' -c:a:0 copy ';
const strtranscodeaudiotranscoding = ' -c:a:0 ${targetaudiocodec} -b:a {0} ';
const strtranscodeaudiodownmixing = ' -ac {0} ';
const strtranscodesubs = ' -map 0:s -scodec copy ';
const strtranscodesubsconvert = ' -map 0:s -c:s srt ';
const strtranscodesubsnone = ' -map -0:s ';
const strtranscodemetadata = ' -map_metadata:g -1 -metadata JBDONEVERSION=1 -metadata JBDONEDATE={0} ';
const strtranscodechapters = ' -map_chapters {0} ';
const strtranscodefileoptions = ' ';
let strFFcmd = '';
if (boltranscodeVideo) {
if (boltranscodeSoftwareDecode) {
strFFcmd += strtrancodebasesw;
} else {
strFFcmd += strtrancodebasehw;
}
}
strFFcmd += strtranscodevideomapping.replace('{0}', videoIdx);
if (boltranscodeVideo) {
strFFcmd += strtranscodevideotranscoding;
if (bolscaleVideo || boluse10bit || boltranscodeSoftwareDecode || bolchangeframerateVideo) {
let stroptions = '';
let strformat = '';
if (bolscaleVideo) {
stroptions += strtranscodevideoscaling;
}
let strChangeVideoRateString = '';
if (bolchangeframerateVideo) {
strChangeVideoRateString = `${strtranscodeframerate.replace('{0}', targetframerate)},`;
}
if (strformat.length > 0) {
strformat += '=';
}
if (boluse10bit && !bolSource10bit) {
strformat += strtranscodevideo10bit;
}
if (!boluse10bit && bolSource10bit) {
strformat += strtranscodevideo8bit;
}
if (boltranscodeSoftwareDecode) {
if (bolSource10bit) {
if (strformat.length > 0) {
strformat += ',';
}
strformat += strtranscodevideoswdecode10bit;
}
if (strformat.length > 0) {
strformat += ',';
}
strformat += strtranscodevideoswdecode;
}
if (strformat.length > 0) {
if (stroptions.length > 0) {
stroptions += ',';
}
stroptions += strtranscodevideoformat.replace('{0}', strformat);
}
if (boltranscodeSoftwareDecode) {
strFFcmd += strtranscodevideooptions.replace('{0}', strChangeVideoRateString + stroptions);
} else {
strFFcmd += strtranscodevideooptions
.replace('{0}', strChangeVideoRateString + strtranscodevideoformathw + stroptions);
}
}
strFFcmd += strtranscodevideobitrate.replace('{0}', optimalvideobitrate);
} else {
strFFcmd += strtranscodevideocopy;
}
strFFcmd += strtranscodeaudiomapping.replace('{0}', audioIdx);
if (boltranscodeAudio) {
strFFcmd += strtranscodeaudiotranscoding
.replace('{0}', optimalaudiobitrate)
.replace('${targetaudiocodec}', targetaudiocodec);
} else {
strFFcmd += strtranscodeaudiocopy;
}
if (boldownmixAudio) {
strFFcmd += strtranscodeaudiodownmixing.replace('{0}', audionewchannels);
}
if (bolforcenosubs) {
strFFcmd += strtranscodesubsnone;
} else if (boldosubs) {
if (boldosubsconvert) {
strFFcmd += strtranscodesubsconvert;
} else {
strFFcmd += strtranscodesubs;
}
}
strFFcmd += strtranscodemetadata.replace('{0}', new Date().toISOString());
if (boldochapters) {
strFFcmd += strtranscodechapters.replace('{0}', '0');
} else {
strFFcmd += strtranscodechapters.replace('{0}', '-1');
}
strFFcmd += strtranscodefileoptions;
/// ///////////////////////////////////////////////////////////////////////////////////////////////////
// response.infoLog += strFFcmd + "\n";
response.preset += strFFcmd;
response.processFile = true;
response.infoLog += 'File needs work. Transcoding. \n';
return response;
};
module.exports.details = details;
module.exports.plugin = plugin;
Reference in new issue View Git Blame Copy Permalink