| PRO 711 | "Of Course I'm Happy, Why?" | (6 songs) | Pravda | 1982 |
| Super 06 | Ridiculing the Apocolypse | Super Electro | 1997 |
| 013 | Mr. Epp Live as All Get Out | (side 1 recorded at the Metropolis 8/12/83, side 2 recorded at several shows) | Dog Tapes | 1983 |
| CSV 7 | Mr. Epp Live as All Get Out | (side 1 recorded at the Metropolis 8/12/83, side 2 recorded at several shows) | Deux Machina | 1983 |
| DS 14 | Irish Potato Famine: Prerequisite to Enlightenment (Introductory Course One) | (15 songs, Mark appears on approximately half of the album) | Dog Tapes | 1985 |
| Mr. Epp Tapes from the Dead | (24 songs, side 1 songs recorded live and at practice, side 2 songs are studio versions) | Box Dog | 1987 | |
| Mr. Epp Live as All Get Out | (reissue) | Box Dog Tapes | 1992 |
| Pravda Volume One | ("Mowhawk Man" and "Mr Epp. Talks to Youngsters") | Pravda | 1982 | |
| Bad Compilation Tapes | ("Mohawk Man" [live] plus one other) | 1982 | ||
| 008 | The Public Doesn't Exist | ("Spooky" and "Genocide", includes track from Speed 20 w/Mark) | Dog Tapes | 1982 |
| CSD 4 | What Syndrome? | ("Strong Arms of the Law" and "Keep on Smiling 'Til the End") | Deux Machina | 1983 |
| First Strike | ("Mowhawk Man" [live], "Intellectual Fool" and "Jaded") | Basic Tapes | 1983 | |
| CSV 10 | Basic Sampler | ("What's Right") | Basic Tapes | 1983 |
| GM001 | Local Product | ("Falling", when passed over a scanner the bar code causes it to read "Beer! Beer!") | Green Monkey | 1983 |
| NAR 013 | Mighty Feeble | ("Jaded") | New Alliance | 1983 |
| Engram 012 | Seattle Syndrome Volume Two | ("Out of Control") | Engram | 1983 |
| NAR 013 | Mighty Feeble | ("Jaded") | New Alliance | 1983 |
| DV-1 | Hoop Skirt/Loop Yarn | ("What's Right" and "Smile" both live in 1983, compilation includes Mudhoney, Limp Richerds) | Box Dog | 1990 |