THUHCSI_Logo

GTN-Bailando: Genre Consistent Long-Term 3D Dance Generation based on Pre-trained Genre Token Network

Submitted to ICASSP 2023

Haolin Zhuang, Shun Lei, Long Xiao, Weiqin Li, Liyang Chen, Sicheng Yang, Zhiyong Wu, Shiyin Kang, Helen Meng

Visualization Comparisons

For each music, two different sets of initial pose codes are used to generate two different dances.

Proposed

Bailando

Information

Genre: 'BR'/'Break'

Music: mBR0

Proposed

Bailando

Proposed

Bailando

Information

Genre: 'HO'/'House'

Music: mHO5

Proposed

Bailando

Proposed

Bailando

Information

Genre: 'JB'/'Ballet Jazz'

Music: mJB5

Proposed

Bailando

Proposed

Bailando

Information

Genre: 'JS'/'Street Jazz'

Music: mJS3

Proposed

Bailando

Proposed

Bailando

Information

Genre: 'KR'/'Krump'

Music: mKR2

Proposed

Bailando

Proposed

Bailando

Information

Genre: 'LH'/'LA style Hip-hop'

Music: mLH4

Proposed

Bailando

Proposed

Bailando

Information

Genre: 'LO'/'Lock'

Music: mLO2

Proposed

Bailando

Proposed

Bailando

Information

Genre: 'MH'/'Middle Hip-hop'

Music: mMH3

Proposed

Bailando

Proposed

Bailando

Information

Genre: 'PO'/'Pop'

Music: mPO1

Proposed

Bailando

Proposed

Bailando

Information

Genre: 'WA'/'Waack'

Music: mWA0

Proposed

Bailando

Ablation Study

Without Energy

Without Pre-trained GTN

Information

Genre: 'LO'/'Lock'

Music: mLO2

Without CE-GTN Loss

Without Teacher-forcing

Genre-consistent Visualization

Genre: 'HO'/'House'; Music: mHO5

Genre: 'KR'/'Krump'; Music: mKR2

Genre: 'LH'/'LA style Hip-hop'; Music: mLH4

Genre: 'LO'/'Lock'; Music: mLO2

Genre: 'MH'/'Middle Hip-hop'; Music: mMH3

Genre: 'WA'/'Waack'; Music: mWA0