You may put yourself in trouble if you attempt to go for an F1 visa stamping as you entered the USA on a dual-intent H4 Visa. US Consulate may assume that you have joined college only to get a work permit. And when you apply for F1 Visa, you will have to show ties to the home country and you will return and your H1B spouse is in the USA and how will you prove that you will return to home country after F1 visa completions??
However, if you attempt and F1 visa is denied, you may come back on H4 visa. Good luck