Something of a Potemkin Village? Acid2 and Mozilla’s Efforts to Comply with HTML4

  • Matthijs den Besten
  • Jean-Michel Dalle
Conference paper
Part of the IFIP Advances in Information and Communication Technology book series (IFIPAICT, volume 365)


Acid3 is the third of three benchmark tests that have been devised to challenge browsers to comply with Internet standards [6]. While Firefox developers at Mozilla had fully embraced the predecessor to Acid3, Acid2, they showed themselves much more reticent this time around. As the quote above indicates they had come to feel that Acid3 would divert attention from the real issues and might actually make it more difficult to achieve “deep compliance” as developers would scramble to come up with quick fixes just to pass the benchmark test. But were these fears justified? To find out, we retrieved the bug reports for bugs in Mozilla’s Bugzilla bug tracker concerning compliance with the HTML4 standard and tried to analyze the differences in the process of bug resolution between bugs that were linked to Acid2 and bugs that were not. In Bugzilla, the bug resolution process passes a number of well-defined stages. Based on the transition rates that we observe we conclude that the process of bug resolution is markedly different for bugs associated with Acid2. In particular, bug resolution appears to be much more chaotic in case of Acid2. This might be symptomatic for “scrambling”, which would explain why developers were not so keen to repeat the experience when Acid3 came around. Further investigations, however, are needed to corroborate this hypothesis.


  1. 1.
    Gabadinho, A., Ritschard, G., Müller, N., Studer, M.: Analyzing and visualizing state sequences in R with TraMineR. Journal of Statistical Software 40(4), 1–37 (2011)Google Scholar
  2. 2.
    Meyer, E.: Eric’s archived thoughts: Acid redux (2008),
  3. 3.
    Sandusky, R.J., Gasser, L., Ripoche, G.: Bug report networks. In: Proc. ICSE Workshop Mining Software Repositories (2004)Google Scholar
  4. 4.
    The Bugzilla Team. The Bugzilla Guide - 3.0.5 ReleaseGoogle Scholar
  5. 5.
    Ung, H., Dalle, J.-M.: Project management in the wikipedia community. In: Proceedings of the 6th International Symposium on Wikis and Open Collaboration, WikiSym 2010, pp. 13–14. ACM, New York (2010); ACM ID: 1832790Google Scholar
  6. 6.
    Wikipedia. Acid3 (2011),
  7. 7.
    Wikipedia. History of Firefox (2011),

Copyright information

© IFIP International Federation for Information Processing 2011

Authors and Affiliations

  • Matthijs den Besten
    • 1
  • Jean-Michel Dalle
    • 2
  1. 1.Chaire Innovation et RégulationEcole PolytechniqueParisFrance
  2. 2.Université Pierre et Marie CurieParisFrance

Personalised recommendations