Intelligent Video Recognition
Last updated: 2022-01-18 16:17:11Download PDF
MPS leverages AI technologies to recognize video content. The result of an intelligent video recognition task includes a recognition score, suggestion, and suspicious video segments. You can decide whether to expose a video based on the suggestion.
Result
MPS can intelligently recognize video images, speech (ASR), and optical characters (OCR).
| Object | Operation | Description |
|---|---|---|
| Video images (People and objects) | ||
| Pornographic content | Checks for pornographic content in video images, including:
| |
| Politically sensitive content | Checks for politically sensitive content in video images, including:
| |
| Speech (Speech to text) | Pornographic content | Checks for keywords for pornographic content in speech |
| Politically sensitive content | Checks for keywords for politically sensitive content in speech | |
| Optical characters Image to text | Pornographic content | Checks for keywords for pornographic content in images |
| Politically sensitive content | Checks for keywords for politically sensitive content in images |
Parameter description
| Field Name | Type | Description |
|---|---|---|
| confidence | Float | Intelligent recognition score (0-100). The higher the score, the more suspicious the content. |
| suggestion | String | There are three types of intelligent recognition suggestions:
|
| segments | Array | Suspicious video segments, which help you locate suspicious content in a video |
Initiating Task
Directions
You can call an API to initiate an intelligent video recognition task or configure automatic triggering of the task upon video upload.
- API: Call the ProcessMedia API, setting
AiContentReviewTaskto the ID of your intelligent video recognition template. - Automatic triggering upon upload: In the console, create a workflow with intelligent video recognition enabled and upload videos to the bucket bound to the workflow.
Creating template
MPS uses templates to represent combinations of intelligent video recognition parameters, which determine which of the following operations MPS performs.
- Recognition of pornographic content in video images
- Recognition of politically sensitive content in video images
- Recognition of pornographic keywords in speech (ASR)
- Recognition of politically sensitive keywords in speech (ASR)
- Recognition of pornographic keywords in images (OCR)
- Recognition of politically sensitive keywords in images (OCR)
MPS provides preset intelligent video recognition templates for common parameter combinations. You can also use a server API to create and manage custom templates.
Obtaining Result
After initiating an intelligent video recognition task, you can wait for the result notification asynchronously or query the result synchronously.
Below is an example of the result returned after query (fields with null values are omitted):
{
"TaskType":"WorkflowTask",
"Status":"FINISH",
"CreateTime":"2019-07-16T06:21:27Z",
"BeginProcessTime":"2019-07-16T06:21:28Z",
"FinishTime":"2019-07-16T06:21:46Z",
"WorkflowTask":{
"TaskId":"2356768367-WorkflowTask-2e1af2456351812be963e309cc133403t0",
"Status":"FINISH",
"InputInfo":{
"Type":"COS",
"CosInputInfo":{
"Bucket":"MyVideoBucket-235303****",
"Region":"ap-beijing",
"Object":"/input/AnimalWorld.mp4"
}
},
"MetaData":{
"AudioDuration":60,
"AudioStreamSet":[
{
"Bitrate":383854,
"Codec":"aac",
"SamplingRate":48000
}
],
"Bitrate":1021028,
"Container":"mov,mp4,m4a,3gp,3g2,mj2",
"Duration":60,
"Height":480,
"Rotate":0,
"Size":7700180,
"VideoDuration":60,
"VideoStreamSet":[
{
"Bitrate":637174,
"Codec":"h264",
"Fps":23,
"Height":480,
"Width":640
}
],
"Width":640
},
"MediaProcessResultSet":[
],
"AiContentReviewResultSet":[
{
"Type":"Porn",
"PornTask":{
"Status":"SUCCESS",
"ErrCode":0,
"Message":"",
"Input":{
"Definition":10
},
"Output":{
"Confidence":98,
"Suggestion":"block",
"Label":"sexy",
"SegmentSet":[
{
"StartTimeOffset":9.5,
"EndTimeOffset":14,
"Confidence":98,
"Suggestion":"block",
"Label":"sexy",
"Url":"http://xxx.vod2.myqcloud.com/xxx/xxx/xx1.jpg",
"PicUrlExpireTime":"2019-07-23T06:21:46Z"
},
{
"StartTimeOffset":16.5,
"EndTimeOffset":18,
"Confidence":80,
"Suggestion":"review",
"Label":"sexy",
"Url":"http://xxx.vod2.myqcloud.com/xxx/xxx/xx2.jpg",
"PicUrlExpireTime":"2019-07-23T06:21:46Z"
},
{
"StartTimeOffset":41,
"EndTimeOffset":49,
"Confidence":97,
"Suggestion":"block",
"Label":"sexy",
"Url":"http://xxx.vod2.myqcloud.com/xxx/xxx/xx3.jpg",
"PicUrlExpireTime":"2019-07-23T06:21:46Z"
}
]
}
}
},
{
"Type":"Terrorism",
"TerrorismTask":{
"Status":"SUCCESS",
"ErrCode":0,
"Message":"",
"Input":{
"Definition":10
},
"Output":{
"Confidence":0,
"Suggestion":"pass",
"SegmentSet":[
]
}
}
},
{
"Type":"Political",
"PoliticalTask":{
"Status":"SUCCESS",
"ErrCode":0,
"Message":"",
"Input":{
"Definition":10
},
"Output":{
"Confidence":0,
"Suggestion":"pass",
"SegmentSet":[
]
}
}
}
],
"AiAnalysisResultSet":[
],
"AiRecognitionResultSet":[
]
},
"TasksPriority":0,
"SessionId":"",
"SessionContext":"",
"RequestId":"xxx-xxx-xxx"
}
As shown above, there are three types of results under WorkflowTask.AiContentReviewResultSet: Porn, Terrorism, and Political.
- For
Porn,Output.Suggestionisblock, which indicates a very high likelihood that the content is pornographic, and you are advised to block it. The confidence score is 98, and the label for the content issexy. - Three suspicious video segments are identified for
Porn, whose start and end times are specified byStartTimeOffsetandEndTimeOffset. - According to the results for
TerrorismandPolitical, no inappropriate content is detected in the video.