Statistical considerations for crowdsourced perceptual ratings of human speech productions

DOI10.1080/02664763.2018.1547692OpenAlexW2901263022WikidataQ90135773 ScholiaQ90135773MaRDI QIDQ5036611

Daniel Fernández, Daphna Harel, Panos Ipeirotis, Tara McAllister

Publication date: 23 February 2022

Published in: Journal of Applied Statistics (Search for Journal in Brave)

Full work available at URL: https://europepmc.org/articles/pmc6746425

zbMATH Keywords

reliabilityvalidityrandom effects modelscrowdsourcingAmazon mechanical turkcommunication disorders

Mathematics Subject Classification ID

Applications of statistics (62Pxx)

Uses Software

• R
• CRAN
• lme4
• MuMIn

Cites Work

• Unnamed Item
• Hierarchical generalised linear models: A synthesis of generalised linear models, random-effect models and structured dispersions
• A Bayesian hierarchical model for inferring player strategy types in a number guessing game
• Fixed-effect variable selection in linear mixed models using \(R^2\) statistics
• That BLUP is a good thing: The estimation of random effects. With comments and a rejoinder by the author
• Repeated labeling using multiple noisy labelers
• Goodness-of-fit measures of R ² for repeated measures mixed effect models
• Maximum likelihood estimation of variance components
• Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems
• Another Look at the Salamander Mating Data: A Modified Laplace Approximation Approach
• Risk Aversion in the Small and in the Large
• Recovery of inter-block information when block sizes are unequal

This page was built for publication: Statistical considerations for crowdsourced perceptual ratings of human speech productions