If you are designing a new project with PernixData, you can have a cluster where not all ESXi servers have a Flash memory (a PCIe card or an SSD); however, there are some design considerations you need to keep in mind, both during the installation part or while using this software.
Virtual To The Core
Virtualization blog, the italian way.