Yes, you can also apply for Sovereign Gold Bonds in the physical form. You should opt for bond delivery type as Physical during the application.
Please note: Incase of physical form/ certificate, the bonds will be held in the RBI's books and the same will be mailed to your registered email id.