I found a workaround. Set your repository to package on beta and release. Tag your alpha builds so the packager thinks it is a beta (ex. v3.0.0 alpha) and then manually change the file development-stage to alpha on curseforge. This way you can control when you want to make an alpha package without it automatically doing it every push and naming it something like "r2012052220321".
What determines the name of the alpha packages? As far as I can tell, it is based off the timestamp of the push to the repository. I know you can control the names of the beta and release packages because they are based on tags. Is there anyway to control or set the name for alpha packages? Thanks.
EDIT: Forgot to add that I'm using Git and I've read through the Repo FAQ, but still can't figure it out. :(