Designing Optical Quantum Computing With Minimal Hardware