Poly(3-alkylthiophenes) (P3[Alkyl]T) exhibit high mobility and efficiency of formation of polaronic charge carriers generated by light absorption, thus finding applications in field effect devices. Excited states of π-stacked dimers of tetra-thiophene oligomers (T4), infinite isolated polythiophene (PT) chains, and P3[Alkyl]T crystals are modeled using configuration interaction singles (CIS) calculations. Excited states in cofacial T4 dimers are mostly localized Frenkel states except for two low energy charge transfer (CT) exciton states, which become the ionization potential and electron affinity levels of T4 molecules at large dimer separation. The lowest excited states in infinite, isolated PT chains and P3[Alkyl]T crystals are intra-chain excitons where the electron and hole are localized on the same chain. The next lowest excited states are interchain, CT excitons in which the electron and hole reside on neighboring chains. The former capture almost all optical oscillator strength and the latter may be a route to efficient formation of polaronic charge carriers in P3[Alkyl]T systems. Changes in optical absorption energies of T4 dimers as a function of molecular separation are explained using CIS calculations with four frontier orbitals in the active space. Shifts in optical absorption energy observed on going from isolated chains to P3[Alkyl]T lamellar structures are already present in single-particle transition energies induced by direct π-π interactions at short range. The electroabsorption spectrum of T4 dimers is calculated as a function of dimer separation and states that are responsible for parallel and perpendicular components of the spectrum are identified.