Spaces:
Runtime error
Runtime error
Update app.py
Browse files
app.py
CHANGED
|
@@ -98,9 +98,11 @@ with gr.Blocks() as iface:
|
|
| 98 |
heatmap_video = gr.Video(label="Video with Anomaly Heatmap")
|
| 99 |
combined_mse_plot = gr.Plot(label="Combined MSE Plot")
|
| 100 |
correlation_heatmap_plot = gr.Plot(label="Correlation Heatmap")
|
|
|
|
| 101 |
with gr.Row():
|
| 102 |
with gr.Group(visible=True) as results_group2:
|
| 103 |
with gr.TabItem("Description"):
|
|
|
|
| 104 |
gr.Markdown("""
|
| 105 |
# Multimodal Behavioral Anomalies Detection
|
| 106 |
|
|
@@ -123,9 +125,7 @@ with gr.Blocks() as iface:
|
|
| 123 |
- **Voice Analysis**: Extracts and segment speaker embeddings from audio using PyAnnote.
|
| 124 |
- **Anomaly Detection**: Uses Variational Autoencoder (VAE) to detect anomalies in facial expressions, body postures, and voice features over time.
|
| 125 |
- **Visualization**: Represents changes in facial expressions, body postures, and vocal tone over time, marking anomaly key points.
|
| 126 |
-
|
| 127 |
-

|
| 128 |
-
|
| 129 |
## InceptionResnetV1
|
| 130 |
The InceptionResnetV1 model is a deep convolutional neural network used for facial recognition and facial attribute extraction.
|
| 131 |
|
|
|
|
| 98 |
heatmap_video = gr.Video(label="Video with Anomaly Heatmap")
|
| 99 |
combined_mse_plot = gr.Plot(label="Combined MSE Plot")
|
| 100 |
correlation_heatmap_plot = gr.Plot(label="Correlation Heatmap")
|
| 101 |
+
|
| 102 |
with gr.Row():
|
| 103 |
with gr.Group(visible=True) as results_group2:
|
| 104 |
with gr.TabItem("Description"):
|
| 105 |
+
gr.Image(value="appendix/Anomay Detection.png", label="Diagram")
|
| 106 |
gr.Markdown("""
|
| 107 |
# Multimodal Behavioral Anomalies Detection
|
| 108 |
|
|
|
|
| 125 |
- **Voice Analysis**: Extracts and segment speaker embeddings from audio using PyAnnote.
|
| 126 |
- **Anomaly Detection**: Uses Variational Autoencoder (VAE) to detect anomalies in facial expressions, body postures, and voice features over time.
|
| 127 |
- **Visualization**: Represents changes in facial expressions, body postures, and vocal tone over time, marking anomaly key points.
|
| 128 |
+
|
|
|
|
|
|
|
| 129 |
## InceptionResnetV1
|
| 130 |
The InceptionResnetV1 model is a deep convolutional neural network used for facial recognition and facial attribute extraction.
|
| 131 |
|