Abstract: This page presents the audio samples for our submitted paper: UniVocal: Unified Speech-Singing Code-Switching Synthesis.
It demonstrates the performance of our proposed method across three different tasks:
Speech-Singing Code Switching (SCS) Synthesis, Textual Empathy TTS, and Singing Generation.
Note: All samples are generated unseen during training.
To demonstrate the effectiveness of our Refined Cent Tokens, we visualize the generated refined cent tokens contours against the Ground Truth (GT) cent tokens. The line charts below illustrate how refined cent tokens draft a structural pitch framework before generating linguistic content.
Sample 1
Sample 2
Sample 3
In this task, UniVocal generates code-switching audio solely from text input. For visualization purposes, black text denotes speech parts, while red text indicates singing parts.
| ID | Text Content | Audio |
|---|---|---|
| 1 | I can still picture my grandmother in her garden, her hands deep in the dark, rich soil. She never seemed to mind the dirt under her nails; she said it was where the real magic happened. Little seed, 'neath the ground, sleep so safe and sleep so sound. That was her little charm for every bulb she planted. It was the simplest tune, but to me, it was the sound of summer. | |
| 2 | I finally left the office. It's that weird, quiet time of evening when the streets are half-empty but the lights make everything feel... magical. It’s like the whole city is holding its breath. Oh, twilight hum, the day is done. Yeah. That’s the feeling. It makes the long day feel worth it, you know? | |
| 3 | My fingers ghosted over the chipped ivory keys, silent relics of songs long since played. Grandma would sit right here, her back straight, telling me stories with every note. Little bird, fly so high, little bird, touch the sky. That was her tune for when the last autumn leaves fell, a gentle farewell to the sun. Hwmm mmm, hwmm mmm mmm. It's funny how a simple melody can hold the entire warmth of a season. | |
| 4 | I was just looking through old photos and found one from that summer at the lake. The water was so bright, and I just remember feeling completely carefree, like nothing else in the world mattered. Oh sunny day, please just stay. It's funny, that simple little thought is what I remember most. Not the big events, just that one perfect, quiet moment. It's still so clear in my mind. |
| ID | Text Content | Audio |
|---|---|---|
| 1 | The old manor's garden had been left to its own devices for years. Elara pushed aside a heavy fern, its fronds damp with morning dew. A half-forgotten lullaby surfaced in her mind, and she began to sing the words softly to the empty air: Where the moss grows green on the silent stone. The simple melody was a ghost on the breeze, a fragile connection to a time long past. | |
| 2 | Ugh, what a day. I swear, everything that could have gone wrong, did. The coffee machine overflowed, I missed the express train by seconds... it's just been a constant chain of little frustrations. It reminds me of a line from an old song, it went like... the universe is playing a practical joke on me. That's exactly how it feels. A big, elaborate prank. Here's hoping the punchline is that tomorrow's amazing. | |
| 3 | I walked through the overgrown remains of my grandfather’s workshop, the air thick with the scent of sawdust and rust. He believed every object held a memory and a rhythm. He would tap a rhythm on a half-finished cabinet and start to sing the line he'd made up for it A story in the grain, a life in the wood He said it helped him find the true shape of things, to listen to what the material wanted to become. | |
| 4 | I've been replaying that conversation over and over in my head. He said I was being too idealistic, that I needed to be more grounded. It's like that old indie song we used to listen to was trying to tell me something all along. I remember the exact lyric, it went... some of us are meant to chase the sun. And maybe that’s the point. Maybe chasing the sun is exactly what I'm supposed to be doing, even if it seems unrealistic to everyone else. It just feels right. |
| ID | Text Content | Audio |
|---|---|---|
| 1 | My clearest memory is of my mother in the garden. She’d be tending the roses, a gentle look on her face, and then she would start singing softly to herself, almost a whisper. Sleep now, little one, the moonbeams kiss your eyes. It wasn't for me, not really. It was for her. A small, private moment of peace. That simple tune was the sound of my childhood, the sound of safety. | |
| 2 | It's funny how the most random songs get stuck in your head, isn't it? Not the complex, award-winning stuff, but the simplest little earworms. I had one all morning, and it reminds me of that classic kids' tune that goes something like this... Shine on, little star, shine on so bright. Just that one line, over and over. It’s almost meditative in its simplicity, completely changing the rhythm of your thoughts. | |
| 3 | It’s been one of those weeks where everything just feels a little heavier, you know? I was getting so stuck in my own head, but then I remembered this silly little song my grandma used to sing. The main line is so simple, it goes... Sun's gonna shine, take it one day at a time. And just thinking about that snaps me out of it. It’s not a magic fix, but it's a start. | |
| 4 | You know that feeling when you're just trying so hard to get something right, but you keep hitting the same wall? It reminds me of this little tune I'd make up when I was a kid, trying to solve a puzzle. It just went... Round and round the thought will go. And I think that's the problem, right? The thought process itself becomes the trap, and you have to find a way to step outside of it completely. | |
| 5 | I ran my thumb over the faded photograph, the corners worn soft with time. It was her, sitting on the porch swing, smiling that gentle way she always did. I could almost hear her voice again, and I softly sang the words she always used to close the day. Sleep now, my darling, the moon's in the sky. Mmm-mm, mmm-mm-mmm. The memory was so vivid it almost hurt. The rest of the melody was a blur, a ghost of a tune that I could never quite grasp, so I just hummed the fragment I could still hold onto. |
In this task, models generates contextually appropriate empathetic speech based solely on the text content.
| ID | Text Content | CosyVoice2 | UniVocal |
|---|---|---|---|
| 1 | This is absolutely fantastic! I honestly didn't think it would work out, but it did. Everything just fell into place perfectly. I have this huge, goofy smile on my face, and I just can't stop. It's like all the lights just turned green at once. I feel so incredibly light and happy right now. | ||
| 2 | This incompetence is going to drive me insane. People aren't doing their jobs, and I'm the one who has to deal with the consequences. The level of carelessness is staggering. I can literally feel my jaw tightening just thinking about the mess I have to fix now. | ||
| 3 | She's a fighter. She's been through so much, but she's still here and she's still smiling. Her resilience gives me so much hope. If she can get through all of that, then surely we can get through this. Her strength is an inspiration. | ||
| 4 | Listen to him brag about how much money he has and who he knows. Does he think that makes him interesting? It's just so shallow and pathetic. He has nothing of substance to say. I can't even be bothered to pretend I'm interested in this conversation anymore. | ||
| 5 | Is this for me? Are you serious? I thought you all forgot it was my birthday! I've been feeling so down about it all day. And then I walk in and see this… all of you here. I'm completely blown away. I had absolutely no idea. | ||
| 6 | I saw something today that reminded me of him, and it just brought all the feelings rushing back. I thought I was doing better, I really did. But it just takes one little thing, and I'm right back where I started. This ache in my heart feels like it will never leave. |
In this task, UniVocal generates different styles of singing voice based on lyrics and prompts.
| Style | Lyrics | Audio |
|---|---|---|
| Rock | Concrete towers, glass and steel.They tell you what you're supposed to feel.Headphones on to block the sound.Of voices buried in the ground.They're selling you a plastic dream.You can hear the silent scream.Flickering screen, a hollow light.Turns your daytime into night.I'm pulling at the wires in my head.Tired of the lies that I've been fed.Yeah, a storm is coming, I can feel the hum.It's time to watch the kingdom come undone.This is the static age, the final show.Gonna watch the whole damn system blow.With a rebel yell and a broken string.We're the thunder that the changes bring.Yeah, the static age is about to crack.And there ain't no turning back. | |
| Blues | Woke up this mornin', rain was pourin' down.Lord, I woke up this mornin', the rain was pourin' down.Got a bad feelin', a bad feelin' in this no-good town.The river's risin', hear it moanin' low.Yeah, that old muddy river, I can hear it moanin' low.Got nowhere to run to, ain't got nowhere left to go..The preacher man, he told me, \"Son, you gotta pray.\".But the devil's at my doorstep and he ain't goin' away.This water keeps on risin', wash my soul away..And I hear that thunder rollin', a sad and lonesome sound.Yeah, that thunder keeps on rollin' all across the ground.'Cause the levee's gonna break, Lord, and we're all gonna drown.Yeah, the levee's gonna break and wash away this town. | |
| Emotional | I'm lost out on an ocean, the waves are crashing high.The moon has hid her face behind a cold and starless sky.I've been paddling for ages, my hands are raw and sore.And I can't remember what I was fighting for.The whispers of the water say \"just let it go, give in\".It's hard to know where I end and where the waves begin.I'm shouting for a shoreline, a signal or a sign.A hope that isn't borrowed, a hope that's truly mine..'Cause every tired muscle is screaming to give way.To sink into the darkness and not face another day.But then a flicker, far away, a fragile, steady spark.A tiny pin of promise tearing through the dark..And I just need a lighthouse to tell me where to go.A single beam of guiding light to cut the undertow.I don't need you to save me, to pull me from the sea.I just need a lighthouse shining back at me.Just give me a reason to make it through the night.Oh, won't you be my lighthouse? My solitary light. | |
| Country | She ain't got a diamond, ain't got a fancy car.But she shines brighter than any downtown star.Got a wildflower tucked behind her ear.And a laugh that makes all my worries disappear.We sit out on the tailgate when the sun gets low.Watchin' the fireflies put on a little show.She knows the name of every constellation in the sky.And she sees the simple truth behind a complicated lie..The world keeps spinning faster, full of noise and full of greed.But all she ever tells me is that all we'll ever need.Is a little bit of honesty and a little patch of land.And the comfort of just holding someone's hand..She's my barefoot queen with a faded denim crown.The richest girl in this whole dusty town.She dances in the dirt when the crickets start to sing.And she makes me feel like I am a king.Yeah, money can't buy the kind of love she brings.My barefoot queen, you're my everything. | |
| Jazz | Streetlights pouring liquid gold.On stories that will ne'er be told.The saxophone, a lonely sigh.Beneath a sleepy, velvet sky.You're sketching circles on the glass.As moments form and moments pass.A quiet corner, table two.There's nothing else but me and you.The clinking ice, a steady beat.To the rhythm of our tapping feet..And darling, in this hazy light.The world outside just isn't right.It's all too loud, it's all too fast.Let's make this stolen moment last.Don't say a word, just let it be.A silent, perfect poetry..We're writing rhymes in midnight ink.Slower than you'd ever think.A melody, both sweet and low.A secret only we can know.Just let the conversation fade.In this sweet serenade we've made.Let's just get lost in midnight ink.And the space between a single blink. | |
| Folk | I left my boots there by the water's edge.Stood on the promises that felt like a fragile ledge.The wind it whispered through the willow trees.Carrying the scent of old, forgotten memories.My father told me, \"Son, this world is hard and cold\".So I built my walls up, did exactly as I'm told.But every stone I laid just made me feel more caged.Like an actor reading lines upon a lonely stage..And oh, the current pulls so steady and so deep.It sings a lullaby to secrets that I keep.I feel the moss beneath my feet, a truth I understand.I'm just a single grain of sand..But the river knows my name, it's heard it all before.In the steady, patient rumble and the whisper at the shore.It doesn't ask me where I'm going or where I'm coming from.It just takes my weary soul and tells me I am home.Yeah, the river knows my name and it washes me clean. | |
| Rap | The city's a chessboard, gotta play it with precision.Made my own decisions, fueled by lonely ambition.Every move is calculated, ain't no time for hesitation.This ain't a conversation, this a hostile coronation.They see me as a pawn, someone they can sacrifice.Didn't know I move in silence, rollin' my own dice.I learned the game from watchin' kings fall from their thrones.Built my own empire from a pile of broken bones.My circle's gettin' smaller, my vision's gettin' clearer.The crown I'm comin' for is gettin' nearer and nearer..Let 'em underestimate the moves I'm gonna make..Every piece they think they're taking is a calculated break..A sacrifice is necessary when the game is on the line..You can have the battle, but the victory is mine..This is the king's gambit, I play the long game right.Sacrifice a little darkness just to get to the light.Yeah, you can take my queen, but you can't checkmate my soul.I'm here to take control, I'm here to make you whole.Yeah, the king's gambit, watch the board rearrange.I am the agent of change, way outside your range. |
Anonymous Submission Demo Page