To create an even more unique experience for your video projects you are able to create your own avatar, which can be then used in any of your projects. šāāļø
The creation of a Studio Express-1 avatar is a paid add-on ($1000/year) for annual plan users only.
Studio Express-1 Avatars can take up to 10 days to process.
The following article takes through the process of creating a Studio Express-1 Avatar including requirements needs for the optimal result.
Please note that the process listed here does not include a voice clone. However you can use our new voice cloning feature to do this
Let's jump in! š„³
Synthesia Requirements
It is advised to practice hand movements, resting position, and reading the script at least once before the first take.
Please note that the avatar's quality depends on Synthesia receiving footage that matches these guidelines. If the standard is not met then a reshoot might be needed.
The requirements for creating a Studio Express-1 Avatar are as follow. It is recommend that you read through each section ot ensure you create optimal footage for your avatar.
You can download a pdf version of the requirements here.
In order to create a Studio Express-1 Avatar, you must be at least 18 years of age.
1. Video Background
When creating Studio Express-1 Avatar footage the background of the video is important. We need to be able cut out the actor from the video.
Hereās what works well:
A GREEN SCREEN BACKGROUND and ensure the screen is well lit with no shadows. This method is required to create the highest quality avatar.
Make sure that the background does not clash with the clothes or skin tone.
Avoid wearing any green with a green background. Your footage may be rejected if this is not followed. Please use a white or blue background if you are wearing green clothing.
Do not remove the background yourself. We will do this before avatar creation.
Q: What do I do if I canāt shoot in a studio?
A: We can use footage shot in an office but be extra careful to make sure the actor stands out from the background and you have good lighting and clear audio.
We recommend that you have access to reshoot footage based on our feedback, if required.
2. Camera
A good quality camera is critical when creating footage. Make sure to shoot with a dedicated video camera.
Hereās what we need for the camera setup:
UHD resolution at 3840x2160
29.97 fps or 30 fps (frame rate per second)
Position the camera at the same height as the actorās eyes
Make sure the focus on the face is sharp
Do NOT use any type of streaming software, webcams or applications that capture your recording over an internet connection. Standard video production technique that consists of a camera and external microphone is required.
Q: What if I canāt shoot at UHD?
A: If you can only shoot HD video footage, thatās fine, but make sure to shoot the exact framing you would like to see for the avatar.
Q: What if I am shooting video in Europe?
A: If you shoot video in Europe with conventional room lighting such as office fluorescents, then you will need to shoot at 25fps to avoid video flicker. This is OK, however if you have studio lighting then please record at NTSC 29.97fps in Europe.
3. Framing
Set the framing for the upper body of the actor.
We recommend filming your actor in UHD 3840x2160 as we are able to reposition the framing slightly, if required.
If you are only able to film in HD 1920x1080, then we ask that you frame the avatar in the exact framing that you want the avatar to be in, as we are NOT able to adjust framing during the Avatar creation process.
Examples of framing
Q: What if I want my avatar to show the upper body?
A: Make sure the hands, fingers and arms always return to the exact same place after speaking in each take, resting at the middle of your torso (or out of shot if you do not want your hands in the frame when resting). We recommend practicing this before turning the camera on. Keeping your hands together can help greatly with this.
Q: Can the actor use hand gestures?
A: Yes but please donāt move your hands outside of your bodyās silhouette or above your chest. Find a comfortable resting position, and come back to it every time you are pausing. It is important to be resting more than you should be gesturing. If your hands and fingers do not come back to the exact same resting position, it is likely that our production team will crop your hands out of the framing
4. Lighting
Good lighting sets the tone and feel for your avatar. Maintain a consistent lighting setup throughout the filming process. Avoid any unnecessary changes in light intensity or direction. Lighting choices can significantly impact the overall aesthetic and contrast of your avatar. We do nor offer post-production adjustments, it's crucial to ensure proper lighting during recording.
Hereās what we recommend:
Use a three-point lighting setup however a two-point lighting setup will also work
Ensure fixed even illumination on the actor
Avoid shadows, particularly across the face
Three-point lighting setup:
ā
Use a main Key light at the front to illuminate the actor, this is positioned slightly to one side to add depth to the face.
Use a Fill light on the other side of the camera to avoid shadows and a Backlight if possible, to highlight the actor and separate them from the background.
Two-point lighting setup:
ā
Use a softer Key light to create contrast from left to right of the image.
This can limit the depth of the subject being filmed if the right type of equipment and intensity is not being used.
Q: What if a two-point or three-point setup is not possible?
A: No problem, just make sure the actor is well lit from the front and clearly stands out from the background. Make sure to check there are no strong shadows across the face and body. Keep the light flat and even.
5. Audio
We use audio to train our AI algorithms to match the lip movement for the actor. We can use the on camera audio but make sure it is clear:
The audio must be perfectly in sync with the video
No echo
No background noise
Make sure only the actor speaks, do not feed lines to the actor
Audio from a lapel mic (lavalier) or a boom mic is ideal, but we can use on camera audio.
Please note that we cannot remove a lapel mic that is visible so please hide well and practice to make sure the lapel mic is not scratching on any moving clothes.
Q: Do I need perfect audio?
A: Yes, please avoid all background noise or people talking other than the actor, especially at the same time.
Weāre looking for 3 clear takes of the actor talking to the camera and as little background noise as possible.
6. Color
In the Avatar creation process, we DO NOT adjust the color grade for the actor.
It is therefore important to provide a video with the look you would like for your avatar:
Avoid dark footage, make sure you have good lighting to avoid this
Shoot with the look you want on camera, or grade the footage afterwards
Please DO NOT provide raw ungraded footage
7. Wardrobe
Itās your Avatar, so dress how you want the Avatar to look!
Hereās some important tips though to get the best footage:
DO NOT wear any clothing that clashes with your background
Avoid green clothing
Makeup must look natural
Keep hair tight to the head, avoid seeing the background through the hair
No sunglasses, we need to be able to see the eyes
No low hats, we need to be able to see the forehead above the eyebrows
No long beards, but short beards are OK, however, please check with customer support before filming.
Tattoos are usually okay but please also check with customer support before filming.
š” TOP TIP š”
Some things to avoid
Strong shadows
Camera blur
Not speaking to camera
Background action
Hair across the face
Sunglasses
Utilsgestures.
If in doubt, follow the rule that the face should be clearly visible to the camera at all times.
8. Glasses
Our Express-1 Technology is always improving and does work with glasses
However, different types of glasses can be difficult for our AI Model to work with. To minimise risk,
we would suggest recording takes with and without glasses. Following the below suggestions for
Recording with glasses:
Make sure that the glasses frames are not positioned close to the performers eyelids.
The performer should try not to rotate or tilt their head too extremely
Avoid see-through frames
9a. Performance Demonstrations
The performance of the actor on camera defines how your avatar videos will look on Synthesia.
Express-1 Avatars are expressive but also emotive.
You can view video demonstration for reference.
9b. Performance - (Head & Eyes)
The below instructions should be followed for optimal results:
The Performer should keep their eyeline towards the camera
Head should move NATURALLY and be EXPRESSIVE
No sneezing or coughing. Take must be redone if so
If reading from a teleprompter, make sure not to have it angled far from the camera
The performer should not be looking too far away from the camera
Do not adjust the distance between the performer and the camera throughout.
Performer should not rock forwards and backwards or move closer to the camera
9c. Performance - (Hands & Arms)
For an avatar with great movement in the upper body and arms, we would
recommend the following:
Keep your hands below the belly button and by your waist
Move hands and arms naturally but keep them below the belly button
Move your upper body as you express and read the script as is natural.
9d. Performance (Emoting)
The performer does not need to be a professional actor
We require pronounced and consistent facial expressions:
When the direction is to be happy, smile, maintain professionalism and calmness, and ensure to smile
When the direction is to be sad, portray negativity, anger, and upset emotions
When the direction is to be excited, exhibit excitement, happiness, and positivity. Enjoy the moment!
š”DIRECTING TIPSš”
For EXCITED ask your performer to:
Persuade
Convince
Seize The Moment
Share a discovery
Encourage
Motivate
For SAD ask your performer to:
Demand
Challenge
Moan
Complain
Confront
Warn
10. Script
The script for Studio Express-1 Avatar can be found here
Q: What if the actor is not a native English speaker?
A: If the actor cannot deliver the script with natural speech then change it. The content does not matter, only the delivery.
Do however maintain the instructions within the <> brackets as we need the actor to close their lips during breaks and pauses with different lengths. Translate the script or create a new one with similar length and break
Q: Should I cut the video clips to provide the exact script?
A: No, please do not cut the videos. We require full takes without any cuts. It does not matter if the actor gets the lines wrong or word skipped. Just ask the actor to continue delivering the script naturally even if they make a mistake.
Q: Do I need to use a teleprompter?
A: You will get the best result if the actor is familiar with the script and then delivers to camera with a teleprompt to assist. If you donāt have a teleprompt then use a tablet positioned as close to the camera as possible, but please do check the eye line.
Q: But I canāt get a teleprompter! The eye line is off camera with my teleprompt! The actor will not follow a script, what do I do?!
A: Our script is designed with our tech requirements in mind.. Using another, may impact the final quality.
If you cannot use our script, show the actor the example video with the script and ask them to speak in a similar style looking directly to the camera lens. They will need to speak for 90s and take pauses with their lips closed.
11. Consent Recording
As part of the submission we require a recording of the performer reading the
following script to camera. This script needs to be read in the actorās native
language, for which we provide translations. For this recording you donāt need to
worry about the style of the delivery, as long as the script is clearly stated by the
performer, while facing the camera.
A copy of the Consent script can be found here
12. Submitting Your Footage
Once you have recorded your footage then send your 3 video takes and your consent recording through to the Synthesia team using the form available in Synthesia.
The files must be:
.h264 codec
.mp4 format
Less than 2gb.
Go into the Avatar section select the Studio avatar option, then follow the instructions.
By submitting your footage you acknowledge that the actor fully understands that their visage will be used to create an AI Avatar, that you agree to the Synthesia Ethical Guidelines and accept the Synthesia Terms and Conditions of Service.
It is important to note that the footage that you provide must have no jump cuts, or edits that have removed parts of the performance from the middle of the takes, otherwise this footage cannot be used to create your Studio Express-1 Avatar.