Best Practices for Designing Highly Available Storage – iSCSI SAN Perspective

This is Part 3 of a 6 part article where I am showing what it takes as best practice while designing a Highly Available Storage from different perspective.

Read my last two articles. Today I am going to talk about iSCSI SAN.

Part 1: Best Practices for Designing Highly Available Storage – Host Perspective
Part 2: Best Practices for Designing Highly Available Storage – FC SAN Perspective

iSCSI SANs on Ethernet do not have the same reliability and built in protocol availability as Fibre Channel SANs; advantages are that they handle longer transmission distances and are less expensive to setup and maintain.

If you require the highest availability, for a SAN under 500m (1640 ft.) a Fibre Channel SAN is recommended.

Note that the number of VLANs that may be active per iSCSI port is dependent on the LAN’s bandwidth. A 10 GigE network can support a greater number.

Ideally, separate Ethernet networks should be created to ensure redundant communications between hosts and storage systems. The cabling for the networks should be physically as widely separated as is practical.

In addition, paths should be handled by separate switching, if direct connections are not used.

If you do not use a dedicated storage network, iSCSI traffic should be either separated onto separate LAN segments, or a virtual LAN (VLAN). VLANs allow the creation of multiple virtual LANs, as opposed to multiple physical LANs in your Ethernet infrastructure. This allows more than one logical network to share the same physical network while maintaining separation of the data.

Ethernet connections to the storage system should use separate subnets depending on if they are workload or storage system management related.

Separate the storage processor management 10/100 Mb/s ports into separate subnets from the iSCSI front end network ports. It is also prudent to separate the front end iSCSI ports of each storage processor onto a separate subnet.

Do this by placing each port from SP-A on a different subnet. Place the corresponding ports from SP-B on the same set of subnets. The 10.x.x.x or through private network addresses are completely available.

For example, a typical configuration for the iSCSI ports on a storage system, with two iSCSI ports per SP would be:

A0: (Subnet mask; Gateway A1: (Subnet mask; Gateway B0: (Subnet mask; Gateway B1: (Subnet mask; Gateway

A host with two NICs should have its connections configured similar to the following in the iSCSI initiator to allow for load balancing and failover:

NIC1 (for example, ‐ SP A0 and SP B0 iSCSI connections NIC2 (for example, ‐ SP A1 and SP B1 iSCSI connections

There is also a restriction on subnets. This has to do with the configuration of the PPP ports. The only restricted addresses are and and the rest of the 192.168.x.x address space are usable with no problems.


About Prasenjit Sarkar

Prasenjit Sarkar is a Product Manager at Oracle for their Public Cloud with primary focus on Cloud Strategy, Oracle Openstack, PaaS, Cloud Native Applications and API Platform. His primary focus is driving Oracle’s Cloud Computing business with commercial and public sector customers; helping to shape and deliver on a strategy to build broad use of Oracle’s Infrastructure as a Service (IaaS) and Platform as a Service (PaaS) offerings such as Compute, Storage, Java as a Service, and Database as a Service. He is also responsible for developing public/private cloud integration strategies, customer’s Cloud Computing architecture vision, future state architectures, and implementable architecture roadmaps in the context of the public, private, and hybrid cloud computing solutions Oracle can offer.

2 thoughts on “Best Practices for Designing Highly Available Storage – iSCSI SAN Perspective

  1. Pingback: Best Practices for Designing Highly Available Storage – Network for iSCSI - Stretch Cloud - Technology Undressed

  2. Pingback: Welcome to vSphere-land! » Storage Links