If an n × n stochastic matrix has a column with no zeros, one can immediately conclude that the chain is ergodic and the state corresponding to that column is persistent and aperiodic. In this paper it is shown that it is decidable whether or not some power of a finite stochastic matrix has a positive column. Some problems regarding positive columns in infinite stochastic matrices are also considered.