The Taylor-Wiles method for coherent cohomology, II