1. Pika Labs is making sound effects feature available to all users for adding sound to videos.
2. Sound effects come from Pika Labs’ in-house text-to-audio model to match video prompt text.
3. Pika Labs sound effects tests include scenarios like a bar at Christmas, a supercar racing, and splashing in a pool.
Pika Labs has expanded their artificial intelligence video platform to include sound effects for all users. This feature allows creators to easily add sound to their videos before or after generation, using an in-house text-to-audio model to match the video prompt text. This new addition builds on existing character voice and lip synching tools on the platform, taking AI video to a new dimension. Other players in the AI video space, like ElevenLabs and Runway, are also experimenting with sound effects and lip sync features.
Users can add sound effects to videos within Pika Labs by toggling a switch during the initial prompt or by adding a separate prompt after the fact. Tests conducted on the platform showed varying results, with some sound effects matching the video prompts well while others needing adjustments in volume or clarity. The tool performed well in creating sounds for scenarios like a busy kitchen or a fireworks display, adding depth and realism to the visuals.
Overall, the addition of sound effects to AI video content is seen as a significant enhancement, improving the overall viewer experience. Pika Labs’ tool, while not perfect, provides enough flexibility for creators to experiment and enhance their videos with accurate and synced sound effects. The ability to hear the sounds of a scene just by looking at an image adds a new level of immersion to the video creation process.