Library - View details   To know more about this section

Towards AI rapper : creating an interactive rap battle experience with generative AI

Document: English. Online
Title
Towards AI rapper : creating an interactive rap battle experience with generative AI / Nikita Kozodoi, Elizaveta Zinovyeva, Zainab Afolabi, Egor Krasheninnikov.
Publication
2025
Subjects
Freestyle Rap
Content
Testu osoa
Physical description
3 or.
Type of material
Document
Eduki mota
Jardunaldiak, biltzarrak
Notes
Dokumentuan: 39th Conference on Neural Information Processing Systems (NeurIPS 2025) Workshop: AI for Music.
This demo lets you experience a real-time interactive rap battle between a human
and AI or two AI opponents. We develop an end-to-end solution that leverages
multiple data modalities and ML models. Our system integrates speech recognition,
emotion detection, language modeling, vision, text-to-speech, and voice cloning.
The system combines multiple models to process user audio input, generates
appropriate and contextually-aware text and synthesizes audio responses aligned
with the background beat music. The demo demonstrates the potential of AI
systems in creative music applications and offers insights into challenges and
opportunities associated with integrating AI systems for interactive entertainment.