2010

pdf dblp
Improving the Generation of Ground Truths Based on Partially Ordered Lists
Julián Urbano | Mónica Marrero | Diego Martín | Juan Lloréns
Proceedings of the 11th International Society for Music Information Retrieval Conference, ISMIR 2010, Utrecht, Netherlands, August 9-13, 2010

doi dblp
Crawling the web for structured documents
Julián Urbano | Juan Lloréns | Yorgos Andreadakis | Mónica Marrero
Proceedings of the 19th ACM Conference on Information and Knowledge Management, CIKM 2010, Toronto, Ontario, Canada, October 26-30, 2010

doi dblp
On the definition of patterns for semantic annotation
Mónica Marrero | Julián Urbano | Jorge Morato | Sonia Sánchez-Cuadrado
Proceedings of the third workshop on Exploiting Semantic Annotations in Information Retrieval, ESAIR 2010, Toronto, Ontario, Canada, October 30, 2010

2011

pdf dblp
Audio Music Similarity and Retrieval: Evaluation Power and Stability
Julián Urbano | Diego Martín | Mónica Marrero | Jorge Morato
Proceedings of the 12th International Society for Music Information Retrieval Conference, ISMIR 2011, Miami, Florida, USA, October 24-28, 2011

pdf dblp
Information Retrieval Meta-Evaluation: Challenges and Opportunities in the Music Domain
Julián Urbano
Proceedings of the 12th International Society for Music Information Retrieval Conference, ISMIR 2011, Miami, Florida, USA, October 24-28, 2011

pdf dblp
The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track
Julián Urbano | Mónica Marrero | Diego Martín | Jorge Morato | Karina Robles | Juan Lloréns
Proceedings of The Twentieth Text REtrieval Conference, TREC 2011, Gaithersburg, Maryland, USA, November 15-18, 2011

2012

doi dblp
Towards minimal test collections for evaluation of audio music similarity and retrieval
Julián Urbano | Markus Schedl
Proceedings of the 21st World Wide Web Conference, WWW 2012, Lyon, France, April 16-20, 2012 (Companion Volume)

pdf dblp
How Significant is Statistically Significant? The case of Audio Music Similarity and Retrieval
Julián Urbano | J. Stephen Downie | Brian McFee | Markus Schedl
Proceedings of the 13th International Society for Music Information Retrieval Conference, ISMIR 2012, Mosteiro S.Bento Da Vitória, Porto, Portugal, October 8-12, 2012

pdf dblp
Current Challenges in the Evaluation of Predominant Melody Extraction Algorithms
Justin Salamon | Julián Urbano
Proceedings of the 13th International Society for Music Information Retrieval Conference, ISMIR 2012, Mosteiro S.Bento Da Vitória, Porto, Portugal, October 8-12, 2012

2013

doi dblp
On the measurement of test collection reliability
Julián Urbano | Mónica Marrero | Diego Martín
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
A comparison of the optimality of statistical significance tests for information retrieval evaluation
Julián Urbano | Mónica Marrero | Diego Martín
The 36th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR '13, Dublin, Ireland - July 28 - August 01, 2013

doi dblp
Minimal test collections for low-cost evaluation of Audio Music Similarity and Retrieval systems
Julián Urbano | Markus Schedl
2013 Volume 2 Issue 1

2014

pdf dblp
What is the Effect of Audio Quality on the Robustness of MFCCs and Chroma Features?
Julián Urbano | Dmitry Bogdanov | Perfecto Herrera | Emilia Gómez | Xavier Serra
Proceedings of the 15th International Society for Music Information Retrieval Conference, ISMIR 2014, Taipei, Taiwan, October 27-31, 2014

doi dblp
Music Information Retrieval: Recent Developments and Applications
Markus Schedl | Emilia Gómez | Julián Urbano
2014 Volume 8 Issue 2-3

2015

doi dblp
How Do Gain and Discount Functions Affect the Correlation between DCG and User Satisfaction?
Julián Urbano | Mónica Marrero
Advances in Information Retrieval - 37th European Conference on IR Research, ECIR 2015, Vienna, Austria, March 29 - April 2, 2015. Proceedings

doi dblp
Information Extraction Grammars
Mónica Marrero | Julián Urbano
Advances in Information Retrieval - 37th European Conference on IR Research, ECIR 2015, Vienna, Austria, March 29 - April 2, 2015. Proceedings

2016

doi dblp
Toward Estimating the Rank Correlation between the Test Collection Results and the True System Performance
Julián Urbano | Mónica Marrero
Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy, July 17-21, 2016

pdf dblp
A Plan for Sustainable MIR Evaluation
Brian McFee | Eric J. Humphrey | Julián Urbano
Proceedings of the 17th International Society for Music Information Retrieval Conference, ISMIR 2016, New York City, United States, August 7-11, 2016

doi dblp
Test collection reliability: a study of bias and robustness to statistical assumptions via stochastic simulation
Julián Urbano
2016 Volume 19 Issue 3

2017

doi dblp
The Treatment of Ties in AP Correlation
Julián Urbano | Mónica Marrero
Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2017, Amsterdam, The Netherlands, October 1-4, 2017

2018

doi dblp
Stochastic Simulation of Test Collections: Evaluation Scores
Julián Urbano | Thomas Nagler
The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA, July 08-12, 2018

2019

doi dblp
Statistical Significance Testing in Information Retrieval: An Empirical Analysis of Type I, Type II and Type III Errors
Julián Urbano | Harlley Lima | Alan Hanjalic
Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, Paris, France, July 21-25, 2019

doi dblp
A New Perspective on Score Standardization
Julián Urbano | Harlley Lima | Alan Hanjalic
Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, Paris, France, July 21-25, 2019

dblp
Proceedings of the 20th International Society for Music Information Retrieval Conference, ISMIR 2019, Delft, The Netherlands, November 4-8, 2019

Proceedings of the 20th International Society for Music Information Retrieval Conference, ISMIR 2019, Delft, The Netherlands, November 4-8, 2019

pdf dblp
The AcousticBrainz Genre Dataset: Multi-Source, Multi-Level, Multi-Label, and Large-Scale
Dmitry Bogdanov | Alastair Porter | Hendrik Schreiber | Julián Urbano | Sergio Oramas
Proceedings of the 20th International Society for Music Information Retrieval Conference, ISMIR 2019, Delft, The Netherlands, November 4-8, 2019

doi dblp
Towards Stochastic Simulations of Relevance Profiles
Kevin Roitero | Andrea Brunello | Julián Urbano | Stefano Mizzaro
Proceedings of the 28th ACM International Conference on Information and Knowledge Management, CIKM 2019, Beijing, China, November 3-7, 2019

2020

doi dblp
Music Tempo Estimation: Are We Done Yet?
Hendrik Schreiber | Julián Urbano | Meinard Müller
2020 Volume 3 Issue 1

doi dblp
Introduction to the Special Collection "20th Anniversary of ISMIR"
Arthur Flexer | Florence Levé | Geoffroy Peeters | Julián Urbano
2020 Volume 3 Issue 1

2021

doi dblp
Leave No User Behind: Towards Improving the Utility of Recommender Systems for Non-mainstream Users
Roger Zhe Li | Julián Urbano | Alan Hanjalic
WSDM '21, The Fourteenth ACM International Conference on Web Search and Data Mining, Virtual Event, Israel, March 8-12, 2021

doi dblp
How do Metric Score Distributions affect the Type I Error Rate of Statistical Significance Tests in Information Retrieval?
Julián Urbano | Matteo Corsi | Alan Hanjalic
ICTIR '21: The 2021 ACM SIGIR International Conference on the Theory of Information Retrieval, Virtual Event, Canada, July 11, 2021

doi dblp
New Insights into Metric Optimization for Ranking-based Recommendation
Roger Zhe Li | Julián Urbano | Alan Hanjalic
SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021