Survey with Audio Clips

Participant Consent Form

This questionnaire is part of an academic study. In order to proceed with the questions, you must read and accept the following terms and conditions.

Title of the Study:

TimbreTron: a WaveNet(CycleGAN(CQT(Audio))) Pipeline for Musical Timbre Transfer.

Background & Purpose of Research:

In this project, we are interested in the overall problem of using machine learning techniques to generate audio within a musical context. In particular, the immediate goal that is related to this questionnaire is timbre transfer between instruments using machine learning techniques.

The results of this questionnaire will help us evaluate the effectiveness of timbre transform using our proposed methods.

Invitation to participate:

You are invited to participate in a user study.

Eligibility:

To participate in this study, you must confirm to be older than 18.

Procedures:

You must first agree to the terms on this form and verify that you are over 18 years of age by clicking the "Accept" button, below. If you do not accept the terms or are ineligible please click "Cancel and Quit". You will then be presented with instructions and questions.

The study will involve listening to some short music clips, answer multiple choice and short answer questions.

Data about the task will be tracked as you perform the task and will be anonymously recorded in a file. The data will then be analyzed using one of the standard statistical analysis applications.

Voluntary Participation & Early Withdrawal:

Your participation in this study is entirely voluntary, and you are free to cease participation at any time, for any reason. You can withdraw any time and receive partial compensation by clicking the “submit” button at the end of the questionnaire. Once the data has been submitted on completion of the study, however, we will not be able to identify and as a result withdraw your data.

Risks/Benefits:

No anticipated risks associated with participation beyond those associated with everyday computer use.

Privacy & Confidentiality:

The data collected from this study will be stored in a password-protected computer that is only accessible by the researchers for a maximum of three years, after which the data shall be deleted. No physical media, such as discs, tapes, recordings, or printouts, of the data will be made or stored. The data is always de-identified, as all participants are anonymized.

Publication of Research Findings:

The data collected will be used as part of research publications and public presentations. Only anonymized and aggregated depictions of the data will be included in these public disseminations of the research.

Possible Commercialization of Findings:

You will not profit from any commercial products resulting from this research.

Compensation:

We are very grateful for your participation in this study and we appreciate your time and assistance. You will receive $2 if you finish all the questions, or on a linear per question scale for partial compensation.

Rights of Subjects:

You waive no legal rights by participating in this study.

Contact Person:

If you have any questions or concerns about this study, please contact the researcher via email:

Xuchan Bao (xuchan.bao@mail.utoronto.ca)

Faculty of Applied Science and Engineering, University of Toronto

If you have any questions about your rights as research participants, please contact the Office of Research Ethics (ethics.review@utoronto.ca, 416-946-3273).

Dissemination of Findings:

You may access published results from https://www.cs.toronto.edu/~rgrosse/

I have read and agree with the above terms & conditions.

Instructions

You will be listening to some audio clips and choose the option that you think best answers the questions.

Note:

- Please answer all questions with care. High-quality answers will be rewarded and low-quality answers will risk rejection.

- Note that some of the samples start / end a fraction of a second before / after others. Those discrepancies can be ignored when comparing whether pieces are identical or not.

- Warning: some clips might sound slightly loud.

Before you start, please tell us something about your musical background.

How many years of music training have you received?

None

1 - 3 years

4 - 6 years

More than 6 years

Do you play one or more instruments?

I play one instrument

I play multiple instruments

Listen to the following music clip. Do you recognize the instrument in this clip?

I think I do, but I am not sure

Yes, definitely

If you answered "I think I do, but I am not sure" or "Yes, definitely", what do you think is the instrument?

Listen to the following music clip. Do you recognize with the instrument in this clip?

I think I do, but I am not sure

Yes, definitely

If you answered "I think I do, but I am not sure" or "Yes, definitely", what do you think is the instrument?

Now, Let's begin.

1. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

(iv) What instrument did clip A primarily sound like to you?

(iv) What instrument did clip B primarily sound like to you?

2. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

3. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

4. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

5. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

6. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

(iv) What instrument did clip A primarily sound like to you?

(iv) What instrument did clip B primarily sound like to you?

7. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

8. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

9. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

10. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

11. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

12. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

13. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

14. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

15. Listen to two audio clips:

Clip A:

Clip B:

The clip A and B may be similar in some ways, and different in others. Rate their similarities with the following criteria:

(i) Instrument similarity

Instrument is very similar (e.g. A and B were generated with two different pianos)

Instrument is similar (A and B are in the same family: both wind instrument, or both string instrument, etc)

Instrument is different

I don’t know

(ii) Musical piece similarity

Musical pieces are nearly identical (e.g. A and B are two different performances of the same piece: perhaps a few notes are different, perhaps timing is slightly different)

Musical pieces are very similar (e.g. A and B are different versions of the same piece, e.g. two different arrangements)

Musical pieces are related (e.g. A and B are two different, but related, pieces)

Entirely different (unrelated) musical piece

I don’t know

(iii) Recording quality

Recording quality is similar (e.g. both are high-fidelity, or both are low-fidelity)

Recording quality is different

I don’t know

(iv) What instrument did clip A primarily sound like to you?

(iv) What instrument did clip B primarily sound like to you?

16. Do you have any comments regarding the above questions?