Explore indexing guidance.
A page being live does not mean it will be indexed. Start by separating discovery, crawling and index selection.