Human embryonic stem cells (hESCs) display substantial heterogeneity in gene expression, implying the existence of discrete substates within the stem cell compartment. To determine whether these substates impact fate decisions of hESCs we used a GFP reporter line to investigate the properties of fractions of putative undifferentiated cells defined by their differential expression of the endoderm transcription factor, GATA6, together with the hESC surface marker, SSEA3. By single-cell cloning, we confirmed that substates characterized by expression of GATA6 and SSEA3 include pluripotent stem cells capable of long-term self-renewal. When clonal stem cell colonies were formed from GATA6-positive and GATA6-negative cells, more of those derived from GATA6-positive cells contained spontaneously differentiated endoderm cells than similar colonies derived from the GATA6-negative cells. We characterized these discrete cellular states using single-cell transcriptomic analysis, identifying a potential role for SOX17 in the establishment of the endoderm-biased stem cell state. Human embryonic stem cells have the capacity to turn into any cell type within the adult. Peter Andrews and colleagues have shown that subtle differences between individual cells can functionally bias the resulting cell type that is produced. Generating and purifying these biased cells may therefore improve the derivation of medically relevant cell types.