Video Tutorials - Gesichtserkennung

 
Tue, 09 May 2023 16:42:53 +0200 last edited: Fri, 02 Jun 2023 16:44:39 +0200  

Einführung




Geht nicht, gibt's nicht - Geklonte Benutzerkonten


...eine Extraerwähnung an dieser Stelle, da es ein außergewöhliches Alleinstellungsmerkmal von Streams und Hubzilla ist. Warum Benutzerkonten klonen? Live-Backups, Umzug von Server zu Server, Resilienz,...



00:00 Klone laufen seit Jahren stabil "in Produktion"
00:30 Erkannte Gesichter synchronisieren sich zwischen Klonen
02:35 Hochgeladene Bilder synchronisieren sich
03:35 Berechtigungen synchronisieren sich
04:55 Der Klon erkennt das neue Gesicht im gerade hochgeladenen (und synchronisierten) Bild
05:25 Posts synchronisieren sich
05:50 ...am Beispiel einer Direktnachricht eines Kontaktes
06:20 Die Kommentare synchronisieren sich
07:00 Klon-Adressen verwalten

Erste Schritte


Video auf Vimeo

00:00 Zusammenfassung
01:00 Zusammenfassung - Demo synchronisieren von Gesichter zwischen geklonten Benutzerkonten
01:25 Zusammenfassung - Benutzerkonten klonen - ein Alleinstellungsmerkmal von Streams und Hubzilla
01:50 Registrierung - neues Benutzerkonto auf Server 1 - Start
02:50 Einstellungen - Profilphoto hochladen
03:20 Einstellungen - Überblick Einstellungen
03:50 Einstellungen - Privatsphäreneinstellungen
04:35 Einstellungen - Benachrichtigungen ausschalten
05:00 Einstellungen - AcitivityPub-Protokoll für Mastodo und Co
05:25 Einstellungen - schmalere Navigationsleiste
05:40 Einstellungen - Benutzerkonten oder Server blockieren
05:50 Einstellungen - Benutzerkonto in eine Datei exportieren - das Warum
05:50 Admin - Registrierung schließen und Überprüfung von Mailadressen
08:00 Addons - finden und aktivieren
08:25 Addon - "Faces" aktivieren (Gesichtserkennung)
08:40 Addon Faces - Menüeintrag und Anpinnen an die Navigationsleiste
09:10 Addon Faces - Start - Profilphoto wird gefunden
09:40 Upload - Bilder - via Photoalbum
10:20 Upload - Bilder - via Post inklusive Berechtigung setzen ("Nur ich")
11:10 Upoad - Bilder - via Dateien
11:45 Addon Faces - erneut starten
12:05 Addon Faces - Gesichter werden gefunden und angezeigt
12:30 Benutzerkonto klonen - Server 2
12:40 Admin - Registrierung öffnen
13:10 Konto Klonen - Adresse des Kanals (Benutzerkonto) in Zwischenablage
13:35 Konto Klonen - Neues Benutzerkonto anlegen auf Server 2
14:10 Konto Klonen - Import eines bestehenden Kontos
14:30 Konto Klonen - Hinweise - Import von Datei wäre möglich
14:50 Konto Klonen - Klonen Benutzerkonto von Server 1 zu Server 2 starten
15:35 Konto Klonen - Abgeschlossen
15:45 Admin - Registrierung schließen
16:20 Synchronisierung zwischen Klonen - Demo Vergleich Benutzerkonto auf Server 1 mit Konto (Klon) auf Server 2
16:45 Synchronisierung zwischen Klonen - Demo Vergleich Dateien
17:30 Synchronisierung zwischen Klonen - Demo Vergleich Berechtigungen
17:55 Synchronisierung zwischen Klonen - Demo Vergleich Gesichter (Addon Faces)
18:10 Addon Faces - Gesichter benamen
18:30 Addon Faces - Zuordung Gesichter zu Benutzerkonto (eindeutige Zuordnung über das Netzwerk)
19:05 Addon Faces - Synchronisieren - von Gesichtern in beide Richtungen (Server 1 <-> Server 2)
19:40 Addon Faces - Berechtigungen - ein andere Benutzer kann ein bestimmtes Bild nicht sehen
20:36 Ende

Gesichter unter Freunden teilen




00:00 "Du benutzt die Gesichtserkennung das erste Mal"
00:15 Magie - die Gesichter tragen Namen von Geisterhand
00:35 Wann werden Gesichter geteilt? - a) Addon Faces installiert, b) nur nah stehende Kontakte
01:00 Teilen von Kontakten funktioniert über Servergrenzen hinweg und sogar zwischen Klonen
01:30 Kurzvorführung Teilen - Beginn
01:50 Es werden nur Gesichter geteilt, die Kontakten zugeordnet sind
02:15 Standardmäßig werden keine Gesichter geteilt
02:30 App "Friend Zoom" installieren
03:00 Beziehungsgrad setzen - auf unter 50 (zwischen 0 und 100)
04:00 Gesichter werden nun miteinander geteilt
05:10 Effekt - Kontakte in Auswahlliste
05:40 Beziehungsgrad zurücksetzen auf über 50
06:15 Gesichter werden nun nicht mehr miteinander geteilt
07:00 Kontrollseite wer mit wem Gesichter teilt
07:15 Welche Gesichter teile ich
07:30 Schwellwert zum Teilen ändern (Schieberegler 0 bis 100)

WebDAV - Dein Computer macht die harte Arbeit


Richte ein Netzlaufwerk auf Deinem Computer ein, das auf die Bilder auf dem Server zugreift. Lasse die Gesichterkennung auf Deinem Computer laufen, um den Server zu entlasten.



00:00 Introduction and summary
00:30 Introduction and summary - admin - block the detection (python) on the server
00:45 Introduction and summary - run the demo
02:05 This tutorial uses two servers and two clones of a user account
02:40 Admin - first server - deactivate the detection and recognition on the server (block Python scripts)
03:25 Admin - second server - same
03:45 Page - settings - URLs to attach the cloud files as network drive
04:30 Page - help - step-by-step instructions
05:15 webDAV - script - there is one to configure webDAV for Linux
05:40 webDAV - script - the parameters
07:25 webDAV - script - run
07:40 webDAV - script - what it does - file /etc/fstab
08:00 webDAV - script - what it does - create mount directory
08:20 webDAV - script - what it does - file secrete (user credentials)
08:45 webDAV - script - command to connect and disconnect to the cloud files
09:10 webDAV - terminal - connect to cloud files
09:20 webDAV - terminal - cloud files are accessible
09:30 webDAV - file manager - cloud files are accessible
09:55 webDAV - terminal - disconnect cloud files
10:30 webDAV - terminal - connect
10:45 Page - help - install python modules
11:20 Page - help - download and install script for face detection and recognition
11:30 Script - clone repository (download)
13:05 Script - check environment
13:45 Script - help - parameters
13:55 Script - parameter - directory - find the images and config file
14:30 Script - parameter - logfile - print out messages
14:45 Script - parameter - exclude - directories like trash
14:55 Script - parameters - all used
15:20 Page - settings - create config file
16:30 Files involved
17:00 Script - run
17:35 Results - files
17:55 Results - browser - faces are detected / shown - cloned user account
18:00 Results - browser - faces are detected / shown - primary user account
18:05 Addon - face - name a face
18:15 Addon - face - synchronized to the clone
18:35 Script - run
18:45 Addon - face - recognized in other images - primary user account
18:55 Addon - face - recognized in other images - cloned user account
18:05 Addon - face - name a face - real contact
19:25 File - names.json - used to hand over a name to the script
19:40 Script - run
19:55 Addon - face - recognized in other images - primary user account
20:05 Addon - face - recognized in other images - cloned user account
20:15 Files - directories - alongside images
20:45 Files - directories - faces.json - content
21:15 Files - directory faces - share.json - used to share faces with contacts - content
22:35 Files - directory faces - share.json - representation of a face
23:05 Files - directory faces - share.json - representation of a face are compared

Die Einstellungen (Settings)




00:00 Überblick
03:15 Admin - Aktivieren/Deaktivieren von Einstellungen für die Benutzer
05:20 Start Tutorial
05:35 Öffnen der Einstellungen
06:10 Teilen von Gesichter - extra Seite
07:50 Browserdarstellung - Zeitstempel - Aufnahmedatum eine Bildes versus Datum des Hochladens
09:25 Browserdarstellung - Zeitstempel - Aufnahmedatum eine Bildes
10:10 Browserdarstellung - Zeitstempel - Aufnahmedatum eine Bildes - Datumsfilter von-bis
10:40 Browserdarstellung - Zeitstempel - Sortieren
11:20 Browserdarstellung - sofortiger Start der Gesichtserkennung nach Benamung von Gesichtern
12:10 Fehlersuche - warum werden einige Gesichter nicht gefunden - Mindestgröße von Gesichtern
13:15 Gesichter finden (Detector)
13:45 Gesichter wiedererkennen (Model)
14:20 Wo liegen die Daten der Gesichtserkennung? - in Dateien
15:00 Admin - Aktivieren von weiteren "Detectors" und "Models"
15:55 "Detector" - einen zweiten "Detector" aktivieren - Effekt
17:30 "Model" - ein zweites "Model" aktivieren -Effekt
18:55 Vergleichen von Gesichtern - extra Seite zum Einstellen der Schwellwerte
19:15 Attribute (Gefühl, Alter, Geschlecht, Rasse) - standardmäßig ausgeschaltet
19:25 Admin - Attribute - Aktivieren
20:00 Attribute - aktiviert - Effekt
21:25 "Detector" (Gesichter finden) - Mindestgröße von Gesichtern - Einstellen und Effekte
24:25 "Model" (Gesichter wiederkennen) - Mindestgröße von Gesichtern - Einstellen und Effekte
25:25 "Model" (Gesichter wiederkennen) - Mindestgröße von Gesichtern - Trainingsdaten (Gesichter mit Namen)
27:55 "Model (Gesichter wiederkennen) - Mindestgröße von Gesichtern - Gesichter ohne Namen
29:40 Model" (Gesichter wiederkennen) - Die ähnlichsten Gesichter einer Person - Trainingsdaten und Teilen mit Kontakten
31:25 "Model" (Gesichter wiederkennen) - "enforce" - Einstellung für Experimente
32:30 "Model" (Gesichter wiederkennen) - Bevorzugung von bestimmten "Detects" und "Models"
33:00 Einblicke - Welche Methode ist die effektivste - Vorbereitungen
34:40 Einblicke - Welche Methode ist die effektivste - Start
36:35 Einblicke - Welche Methode ist die effektivste - mehr und mehr Gesichter benennen - Effekte
41:35 Zurücksetzen auf Voreinstellungen - für Experimente ("experimental") und den Normalbetrieb ("reset")
42:51 Ende
Video Tutorials - Face Detection and Recognition

 
Mon, 08 May 2023 00:46:30 +0200 last edited: Fri, 02 Jun 2023 16:53:42 +0200  

Introduction





Below more video tutorials...

Can't be done, doesn't exist - Synchronization between cloned User Accounts


...a unique feature of Streams and Hubzilla.

(Please connect if you want to see the video.)



00:00 Synchronization of cloned user accounts has been running stable for years
00:30 A primary user account and its clone on a different server
01:00 Many clones are possible
01:35 Detected faces and names of faces are synchronized between clones
02:40 Pictures (uploaded) are synchronized
03:40 Permissions are synchronized (example picture)
04:50 Name of face is synchronized (again)
05:20 Posts are synchronized
05:45 Send direct message from another account
06:40 The post and the comments are synchronized

Beginners Guide


Touches many topics. You are in full control of how can use your faces.

Link to video on Vimeo

00:00 summary - visual - what will be demonstrated
01:10 summary - recognized faces are synchronized between cloned accounts (server 1 <-> server 2)
01:50 summary - as text
02:30 register an account at server number 1
03:50 upload profile photo
04:40 a look through the settings
04:50 setting - security and privacy
05:30 setting - notifications
05:45 admin - setting - registration without mail verification (fake mail address possible)
06:30 setting - narrow navigation bar
06:35 setting - block channels, block servers
06:45 export channel - to file (as backup or to register again after removal of account)
07:30 addons - find and install addons
07:45 addon Faces - activate addon faces
08:00 addon Faces - how to open and pin it to the navbar
08:20 addon Faces - start for the very first time
08:35 upload pictures - photo app
09:00 upload pictures - post
09:25 upload pictures - post - permission
09:35 upload pictures - files app - permissions
10:00 permission on files - set permission of a single picture ("only me")
10:25 permission on files - demonstrate the effect for an observer - hide a single picture
10:55 permission on files - set permission for directories including files and subfolders ("only me")
11:25 permission on files - demonstrate the effect for an observer - hide all pictures
11:35 addon Faces - start face detection
12:00 addon Faces - name faces
12:10 addon Faces - name faces - use accounts/ contacts that are unique in the decentralized network
12:15 addon Faces - name faces - use any name (just a letters)
12:40 addon Faces - share faces with close contacts only (default: nothing is shared with anybody)
12:50 addon Faces - demonstrate the effect of permissions
13:00 addon Faces - effect of permission - an observer sees no image (set to "only me")
13:15 permission on files - set permission for directories including files and sub folders to "public"
13:30 addon Faces - effect of permission - an observer sees all images again
14:00 clone account - from server 1 to server 2
14:25 clone account - register an account at a server number 2
15:20 admin - setting - registration without mail verification (fake mail address possible)
15:30 clone account - import an existing channel - from server number 1
15:45 clone account - import an existing channel - from file would be possible
15:55 clone account - import an existing channel - use the old (existing) channel address at server number 1
16:10 clone account - completed
16:15 admin - setting - deactivate new registrations
16:35 clone account - login with original account at server number 1
16:50 clone account - demonstrate synchronization between clones (posts, files, permissions, contacts,...)
17:20 addon Faces - activate for clone at server number 2
17:40 addon Faces - demonstrate the synchronization of faces between clones (server 1 <-> server 2)
18:25 bonus - posts - format text using markdown (headlines, bold, lists,...)
19:30 bonus - posts - permissions
19:40 bonus - posts - special markdown - replacements of observer url and observer name
20:20 bonus - posts - end-to-end encryption (addon Secrets)
22:00 bonus - find a channel via app "Directory"
22:50 bonus - connect to contacts (to allow comments)
23:44 the end

WebDAV - Let your Computer do the hard Work


Connect your computer to the cloud files. Run the face detection and recognition on your computer (to reduce server load).

(Please connect if you want to see the video.)



00:00 Introduction and summary
00:30 Introduction and summary - admin - block the detection (python) on the server
00:45 Introduction and summary - run the demo
02:05 This tutorial uses two servers and two clones of a user account
02:40 Admin - first server - deactivate the detection and recognition on the server (block Python scripts)
03:25 Admin - second server - same
03:45 Page - settings - URLs to attach the cloud files as network drive
04:30 Page - help - step-by-step instructions
05:15 webDAV - script - there is one to configure webDAV for Linux
05:40 webDAV - script - the parameters
07:25 webDAV - script - run
07:40 webDAV - script - what it does - file /etc/fstab
08:00 webDAV - script - what it does - create mount directory
08:20 webDAV - script - what it does - file secrete (user credentials)
08:45 webDAV - script - command to connect and disconnect to the cloud files
09:10 webDAV - terminal - connect to cloud files
09:20 webDAV - terminal - cloud files are accessible
09:30 webDAV - file manager - cloud files are accessible
09:55 webDAV - terminal - disconnect cloud files
10:30 webDAV - terminal - connect
10:45 Page - help - install python modules
11:20 Page - help - download and install script for face detection and recognition
11:30 Script - clone repository (download)
13:05 Script - check environment
13:45 Script - help - parameters
13:55 Script - parameter - directory - find the images and config file
14:30 Script - parameter - logfile - print out messages
14:45 Script - parameter - exclude - directories like trash
14:55 Script - parameters - all used
15:20 Page - settings - create config file
16:30 Files involved
17:00 Script - run
17:35 Results - files
17:55 Results - browser - faces are detected / shown - cloned user account
18:00 Results - browser - faces are detected / shown - primary user account
18:05 Addon - face - name a face
18:15 Addon - face - synchronized to the clone
18:35 Script - run
18:45 Addon - face - recognized in other images - primary user account
18:55 Addon - face - recognized in other images - cloned user account
18:05 Addon - face - name a face - real contact
19:25 File - names.json - used to hand over a name to the script
19:40 Script - run
19:55 Addon - face - recognized in other images - primary user account
20:05 Addon - face - recognized in other images - cloned user account
20:15 Files - directories - alongside images
20:45 Files - directories - faces.json - content
21:15 Files - directory faces - share.json - used to share faces with contacts - content
22:35 Files - directory faces - share.json - representation of a face
23:05 Files - directory faces - share.json - representation of a face are compared

The Settings Page


Set detectors, models, minimum size of faces and much more.

(Please connect if you want to see the video.)



00:00 Overview
01:25 Admin - switch on - "experimental" and "immediately"
01:55 Admin - switch on/off- effect for user
02:30 Start tutorial
02:40 How to open the settings page
03:05 Share faces - dedicated page
04:00 Share faces - demo - who is sharing faces depending on affinity slider
04:40 Browser appearance - filter and sort
04:55 Browser appearance - exif - the date when a picture was taken
05:30 Insights - switch on - models and faces
06:10 Insights - faces - show content of file (internal data of face recognition)
07:40 Browser appearance - filter by time - last modified (default)
08:00 Browser appearance - filter by time - exif - when a picture was taken
08:40 Browser appearance - filter by time - exif  - effect of date filter
09:15 Browser appearance - sort by time
10:00 Browser appearance - immediat search (more a behavior of the recognition than appearance)
10:40 Detectors and recognition models - what do they do
11:30 Detectors and recognition models - distance metrics - how faces are found
11:40 Detectors and recognition models - file - face statistics
12:30 Detectors - enable a second detector
13:30 Detectors - enable a second detector - effects - file - face statistics
14:10 Recognition models - enable a second model
15:00 Recognition models - enable a second model - effects - file - face statistics
15:40 Distance metrics - file - faces statistics
16:15 Distance metrics - enforce to use all distance metrics - how and recommendation
17:05 Facial attributes - switch all on
18:00 Facial attributes - switch all on - effects - file - face statistics
18:35 Facial attributes - not used at the moments - files where they are stored
19:35 Remove faces
19:45 Remove faces - everything is stored in files (by the addon)
19:50 Remove faces - page
20:00 Remove faces - page - remove all results of a detector
20:10 Remove faces - page - remove all results of a recognition model
20:25 Remove faces - effects
20:45 Detection - tune
20:50 Detection - tune - minimum size of faces - set
22:00 Detection - tune - minimum size of faces - effects - browser - what the user sees
22:10 Detection - tune - minimum size of faces - effects - file - faces statistics
22:30 Delete data files to remove all results of detection and recognition
23:30 Recognition - tune
24:10 Recognition - tune - training data - minimum size of faces - set - value to big
24:50 Recognition - tune - training data - minimum size of faces - effect - no face recognized
25:35 Recognition - tune - training data - minimum size of faces - set - value decent
24:50 Recognition - tune - training data - minimum size of faces - effect - face recognized
26:35 Recognition - tune - results - minimum size of faces - set - value to big
27:35 Recognition - tune - results - minimum size of faces - effect - no face recognized
28:15 Recognition - tune - results - minimum size of faces - set - value decent
28:30 Recognition - tune - results - minimum size of faces - effect - face recognized
28:45 Recognition - tune - most similar faces - explanation
29:25 Insights - what files are written
29:55 Admin - activate all detectors and model
30:25 Insights - faces - activate all detectors and models
30:45 Insights - faces - activate all detectors and models - delete all result
31:00 Insights - faces - activate all detectors and models - start detection
31:35 Insights - faces - activate all detectors and models - effects - browser
31:50 Insights - faces - activate all detectors and models - effects - file statistics
32:40 Insights - history - model statistics - what combination of detector-model does the best job
33:35 Insights - history - model statistics - results - populate with results (by naming faces)
35:40 Insights - history - model statistics - results - order changes if names are set in browser
37:15 Insights - history - model statistics - results - see the results
37:45 Presets - experimental
38:15 Presets - reset - the defaults
38:59 The end

Find the best Settings for your Pictures


In theory the face recognition is quite accurate. What do real live examples show?
How to find the settings that work best for your pictures and how to apply them?

(Please connect if you want to see the video.)



00:20 Mode Probe explained in short
02:40 Pages - help - links to the pages thresholds and probe
03:20 Page - thresholds - distance metrics
03:45 Page - probe - step-by-step instructions
04:10 Start the tutorial with a fresh system (no pictures yet)
04:25 Upload pictures
04:40 Mount cloud files via webDAV (to later save CPU and memory on the server)
06:15 Admin - block Python scripts on the server
06:40 Admin - activate all detectors, models, distance metrics
07:35 Settings - activate all detectors, models, distance metrics
09:10 Run the Python script on your computer to detect faces
09:50 Watch the log file to see what is going on
10:50 Addon - name faces
11:35 Upload more pictures - every picture contains just one face of the persons we named before
13:45 Upload more pictures - no picture does contain a face of the persons we named before
15:15 Start probe - via web browser (1st way)
15:40 Start prove - via terminal on your computer (2nd way)
15:45 Results of probe - file probe.csv - interpretations
21:50 Results of probe - file statistics.csv - look at internal data of the face recognition
24:30 Effectiveness of face recognition - real live
25:15 Effectiveness of face recognition - the theory
25:15 Why the feature "probe" was implemented - compare the theory against real live performance
26:20 Results of probe - find the combination that works best for your real live pictures
29:15 Apply the best combination - thresholds
30:00 Apply the best combination - settings
30:40 (Admin - activate the detectors, settings and distance metrics)
31:10 Remove results for detectors and models we do not want to use anymore (blocked)
31:50 (Admin - allow the python scripts)
32:20 Remove results for detectors and models we do not want to use anymore (again)
32:40 Addon - start the face recognition again using your optimized settings
33:20 File statistics.csv - show that unused detectors and models where removed
33:43 The end