2017年3月26日 星期日


Analysis and synthesis of the violin playing style of Heifetz and Oistrakh




Our experiment on expressive synthesis contains two tasks.
The first task is to synthesize excerpts that are part of our dataset (i.e. excerpts that have been observed in the analysis stage), in order to test the feasibility of our proposed features and parameters to simulate the fine structure of the original sound.
Here, we take Brahms' Violin Concerto, Mov. I, bars 129-132, and Sibelius' Violin Concerto, Mov. III, bars 133-135 as examples.
To receive a synthetic sound that looks like the original, the statistical parameters are from the excerpt itself. In other words, we calculate the parameters of each of the two excerpts independently, and apply them to synthesize the playing style of Heifetz or Oistrakh.

The second task is to synthesize an excerpt outside of the dataset, Beethoven's Violin Sonata No.5, Op.24, Mov. I, bars 1-10, which is also known as Spring. The parameters, however, are from the entire dataset, because we do not have any prior knowledge on the expressive parameters of Spring. In other words, we want to test via this task whether a computer is able to imitate the two violinists' playing style on an excerpt, which is not collected in the dataset.


Task 1: Synthetic excerpts from the dataset


The original sources of these music pieces are of gramophone recordings, which include background accompaniment such as cello or second violin and the white noise.
To avoid the influence of the background accompaniment, we use a high-pass filter to remove it.
In Sibelius' case, the threshold is 250 Hz, since the lowest note of this excerpt is 277 Hz,
while in Brahms' case, the threshold is 300 Hz, since the lowest note of this excerpt is 311 Hz.
Original version(from gramophone recordings)
Sibelius' VC, Op.47, Mov III, bars 133-135 Brahms' VC, Op.77, Mov I, bars 129-132
HeifetzWavFile HeifetzWavFile
OistrakhWavFile OistrakhWavFile



In task 1, the synthetic parameters are from the original excerpt.
For the similarity between the original and synthesis versions, some post-processings are adopted. That is, we adjust the volume of synthesis version to make the energy equal to the original version, which has also been modified by the high-pass filter.
Synthesis version(based on proposed features)
Sibelius' VC, Op.47,Mov III,bars 133-135 Brahms' VC, Op.77,Mov I, bars 129-132
HeifetzWavFile HeifetzWavFile
OistrakhWavFile OistrakhWavFile





Task 2: Synthetic excerpt outside of the dataset


Since we don't have the gramophone recording of Spring, the original sources are from the Youtube .
Beethoven' VS, No.5, Op.24, Mov I, bars 1-10
Spring(from Youtube link)
link 1 link 2
Heifetz Heifetz
Oistrakh Oistrakh



For the synthesis of Spring, we narrow down the scope of excerpts to those, whose beat per minute (BPM) is around 120, according to the Allegro notation on the score of Spring. Specifically, we choose 18 excerpts from the dataset, take the mean value of each parameter over such ones, and then apply them to the synthesis system. The synthesis process is the same as the first task.
The post-processings adopted in task 1 are also applied to task 2.
Synthesis version(based on proposed features)
Beethoven' VS, No.5, Op.24, Mov I, bars 1-10
Spring
HeifetzWavFile
OistrakhWavFile





Dataset


To compare the style of Heifetz and Oistrakh, we choose the music pieces that both of them have played before. In particular, we focus on the work recorded in the prime of their lives, for they are considered to be representative of their style.
In addition, we pick only the violin solo parts to keep the influence from the background accompaniment minimal.
As illustrated in Table 1, we select 26 excerpts from six famous violin concertos from gramophone recordings, whose information is listed in Table 2.


Table 1: Dataset Information of 26 Excerpts
ComposerMusic NameMov.Bars
L. V. BeethovenViolin concerto in D major, Op. 61 I96, 97-98, 100-101, 128-130, 130-131, 134-136, 137-139
II77, 81-82, 83
J. BrahmsViolin concerto in D major, Op. 77 I115-118, 124-127, 129-132
P. I. TchaikovskyViolin concerto in D major, Op. 35 I28-29, 31-33, 39-41, 105-106
M. C. F. BruchScottish Fantasy, Op.46 II97-101, 107-109
E. V. A. LaloSymphonie espagnole in D minor, Op. 21 I41-51, 66-69
J. SibeliusViolin concerto, Op. 47 I26-31
III124-127, 128-130, 133-135, 146-152



Table 2:Dataset Information of Six Gramophone Recordings
ComposerMusic NameHeifetz Info.Oistrakh Info.
LabelYearLabelYear
L. V. BeethovenViolin concerto in D major, Op. 61 RCA - RR 6082-M1959 Columbia - FCX 8171960
J. BrahmsViolin concerto in D major, Op. 77 RCA Victor Red Seal - LM-19031955 Columbia - SAX 24111961
P. I. TchaikovskyViolin concerto in D major, Op. 35 RCA Victor Red Seal - LSC-21291958 Deutsche Grammophon - DGM 181961954
M. C. F. BruchScottish Fantasy, Op.46 RCA Victor Red Seal - LSC-26031962 London Records - CS 63371962
E. V. A. LaloSymphonie espagnole in D minor, Op. 21 La Voix De Son Maître - FBLP 10191953 Columbia - FCX 4271955
J. SibeliusViolin concerto, Op. 47 RCA Victor Red Seal - LM-2435 1960 Columbia Odyssey - Y 30489 1971

2017年2月13日 星期一

[課程]2017類比電子電路實作


課程老師: 蘇文鈺

Email: alvinsu@mail.ncku.edu.tw

課程助教: 林芳妤 程鈺涵
Email: 2017circuit@gmail.com
音樂多媒體系統實驗室(資訊系館新大樓7F 65707)

出席:10%
期中考:15%
期末作業:15%
作業:60%

作業繳交請寄到助教信箱(部分作業需要在課堂上先給助教檢查),截止時間到上課當天23:59,超過時間分數打7折。詳細作業繳交事項請看下面的作業說明。


課程內容

2017/02/23(四) #Week1     課程說明 / Circuit Lab
2017/03/02(四) #Week2     類比電子電路簡介/ 解焊練習
2017/03/09(四) #Week3     類比電子電路簡介 運算放大器/ CircuitLab HW2/儀器使用
2017/03/16(四) #Week4     RLC電路、一階二階高通低通濾波器 /焊接練習
2017/03/23(四) #Week5     Low Pass Filter
2017/03/30(四) #Week6     校際活動週(停課)
2017/04/06(四) #Week7     電源供應器: 模擬, 實作
2017/04/13(四) #Week8     類比電子電路簡介+課程複習+電供實作
2017/04/20(四) #Week9     特性曲線:實作+Notch filter
2017/04/27(四) #Week10   期中考 (上機考)
2017/05/04(四) #Week11   電子零件檢測+三階高通實作
2017/05/11(四) #Week12   模擬電路(Class-A Audio Amplifier)
2017/05/18(四) #Week13   實作電路(Class-A Audio Amplifier)
2017/05/25(四) #Week14   實作電路(Class-A Audio Amplifier)
2017/06/1(四) #Week15     模擬電路(Headphone Amplifier)


無法註冊Circuit Lab的人可以使用以下帳號: 

Alvin.WY.Su
密碼:screamlab2017

2016年3月19日 星期六

[課程]2016類比電子電路實作

課程老師: 蘇文鈺

Email: alvinsu@mail.ncku.edu.tw

課程助教: 李品皜
Email: s00282526941@gmail.com
音樂多媒體系統實驗室(資訊系館新大樓7F 65707)

出席:10%
期中考:15%
期末考:15%
作業:60%

作業繳交請寄到助教信箱(部分作業需要在課堂上先給助教檢查),截止時間到上課當天23:59,超過時間分數打7折。詳細作業繳交事項請看下面的作業說明。



課程內容(更新日期:0626)

2016/02/26(四) #Week1     課程說明 / Circuit Lab
2016/03/03(四) #Week2     類比電子電路簡介
2016/03/10(四) #Week3     焊接與儀器使用
2016/03/17(四) #Week4     RLC電路、一階二階高通低通濾波器、運算放大器
2016/03/24(四) #Week5     Low Pass Filter
2016/03/31(四) #Week6     春節
2016/04/07(四) #Week7     電源供應器:   模擬, 實作
2016/04/14(四) #Week8     雙極性電晶體
2016/04/28(四) #Week9     課程複習
2016/04/21(四) #Week10   期中考 (上機考)
-----------------------------------------------------------------------
2016/05/05(四) #Week11   模擬電路(Class-A Audio Amplifier)
2016/05/12(四) #Week12   實作電路(Class-A Audio Amplifier)
2016/05/19(四) #Week13   模擬電路(Third Order High Pass Filter)
2016/05/26(四) #Week14   實作電路(Third Order High Pass Filter)
2016/06/02(四) #Week15   期末考 (上機考)
2016/06/09(四) #Week16   期末作業(Headphone Amplifier)
2016/06/16(四) #Week17   期末作業(Headphone Amplifier)

期末作業 Demo 時間2016/06/27(一) 15:00~17:00

無法註冊Circuit Lab的人可以使用以下帳號: 

Alvin.WY.Su
密碼:screamlab

2016年3月15日 星期二

Music Files of Automatic Violin Synthesis Using Expressive Musical Term Features

I. Synthetic sounds based on MIDI non-expressive version

Music Files MIDI
None Maestoso Scherzando Risoluto
Origin sound - - -
pEC - sound sound sound
3EC - sound sound sound

II. Synthetic sounds based on amateur's non-expressive version

Music Files Amateur
None Maestoso Scherzando Risoluto
Origin sound sound sound sound
pEC - sound sound sound
3EC - sound sound sound

III. Synthetic sounds based on professional violinist's non-expressive version

Music Files Expert
None Maestoso Scherzando Risoluto
Origin sound sound sound sound
pEC - sound sound sound
3EC - sound sound sound

IV. The case has silent gaps between the shortened Noten and Noten+1 (sound) / The fixed version (sound)

2016年2月20日 星期六

[課程]2016訊號與系統

本週公告:

課程老師:蘇文鈺 
  • Email:alvinsu@mail.ncku.edu.tw
課程助教:施季青 薛佳綾
  • Email:signalsystem105@gmail.com(有問題詢問請先email告知)
  • Lab位置:65707(資訊新系館7樓走到底右轉)
MatLab下載連結 :
課程投影片:
 
作業成績:
評分標準:
  • 課堂lab 40%
  • 期末project 35%
  • 期末筆試 15%
  • 期中上機 10%
  • 平常成績
  課程進度:

  • 2016/02/22 Week #1
  • 2016/02/29 Week #2
    • 和平紀念日補假!
  • 2016/03/14 Week #4
    • 同學講解lab1
    • 老師會找1~5組討論期末專題
    • 本週開始為下午1:10上課
    • lab2
  • 2016/03/21 Week #5
  • 2016/03/28 Week #6
  • 2016/04/04 Week #7
    • 清明節+兒童節放假!
  • 2016/04/11 Week #8
    • 前三組報告專題
    • lab5
  • 2016/04/18 Week #9
    • 4~6組報告專題
    • lab6
  • 2016/04/25 Week #10
    • 7~8組報告專題
    • lab7
  • 2016/05/02 Week #11
  • 2016/05/09 Week #12
  • 2016/05/16 Week #13
    • 2~4組報告
    • lab10
      • 繳交期限到30號 
  • 2016/05/23 Week #14
    • 期中筆試
    • 筆試題目
      • 可以再寫一次,計作lab成績
         
  • 2016/05/30 Week #15
  • 2016/06/06 Week #16
    • 期末上機
    • 繳交至 signalsystem105@gmail.com
      • 檔案格式為「上機考_學號_姓名.zip」
    • lab12
  • 2016/06/13
    • 2~8組報告
    • lab11 & 12 發表
  • 2016/06/20
    • 期末project發表
    • 學期結束,辛苦各位了

2015年6月5日 星期五

Music Files of SEPARATION OF MUSICAL NOTES WITH HIGHLY OVERLAPPING PARTIALS USING PHASE AND TEMPORAL CONSTRAINED COMPLEX MATRIX FACTORIZATION

  • The sound example 1: The temporal smoothness parameter γ [All]
    • Mixture : A3+A4
    • Original : A3   A4
    • Separated with gamma=0 : A3   A4
    • Separated with gamma=0.1 : A3   A4
    • Separated with gamma=0.5 : A3   A4
    • Separated with gamma=1 : A3   A4
  • The sound example 2: Piano [All]
  • [a] Fifths (A3+E4)
    • Mixture : A3+E4
    • Original : A3   E4
    • Separated with gamma=0 : A3   E4
    • Separated with gamma=0.5 : A3   E4
    [b] Octaves (A3+A4)
    • Mixture : A3+A4
    • Original : A3   A4
    • Separated with gamma=0 : A3   A4
    • Separated with gamma=0.5 : A3   A4
    [c] Tritaves (A3+E5)
    • Mixture : A3+E5
    • Original : A3   E5
    • Separated with gamma=0 : A3   E5
    • Separated with gamma=0.5 : A3   E5
  • The sound example 3: Guitar [All]
  • [a] Fifths (A3+E4)
    • Mixture : A3+E4
    • Original : A3   E4
    • Separated with gamma=0 : A3   E4
    • Separated with gamma=0.5 : A3   E4
    [b] Octaves (A3+A4)
    • Mixture : A3+A4
    • Original : A3   A4
    • Separated with gamma=0 : A3   A4
    • Separated with gamma=0.5 : A3   A4
    [c] Tritaves (A3+E5)
    • Mixture : A3+E5
    • Original : A3   E5
    • Separated with gamma=0 : A3   E5
    • Separated with gamma=0.5 : A3   E5
  • The sound example 4: Violin [All]
  • [a] Fifths (A3+E4)
    • Mixture : A3+E4
    • Original : A3   E4
    • Separated with gamma=0 : A3   E4
    • Separated with gamma=0.5 : A3   E4
    [b] Octaves (A3+A4)
    • Mixture : A3+A4
    • Original : A3   A4
    • Separated with gamma=0 : A3   A4
    • Separated with gamma=0.5 : A3   A4
    [c] Tritaves (A3+E5)
    • Mixture : A3+E5
    • Original : A3   E5
    • Separated with gamma=0 : A3   E5
    • Separated with gamma=0.5 : A3   E5