RE: Murray Gell-Mann, not Freeman Dyson
I agree that Gell-Mann thought quarks were simply a mathematical tool that helped described the observed spectra of mesons and baryons. However, your second statement is wrong: he used "quarks" in his 1964 paper along with a citation to Finnegan's Wake.
M. Gell-Mann
A schematic model of baryons and mesons
Physics Letters, Volume 8, Issue 3, 1 February 1964
http://dx.doi.org/10.1016/S0031-9163(64)92001-3
http://www.sciencedirect.com/science/article/pii/S0031916364920013