This phase II trial tests how well elacestrant with everolimus works for the treatment of estrogen receptor (ER) positive endometrial cancer that has come back after a period of improvement (recurrent), that may have spread from where it first started to nearby tissue, lymph nodes, or distant parts of the body (advanced) or that has spread from where it first started (primary site) to other places in the body (metastatic). Estrogen can cause the growth of cancer cells. Elacestrant lowers the amount of estrogen made by the body. This may help stop the growth of cancer cells that need estrogen to grow. Everolimus is in a class of medications called kinase inhibitors. It is also a type of angiogenesis inhibitor. Everolimus works by stopping cancer cells from reproducing and by decreasing blood supply to the cancer cells. Giving elacestrant with everolimus may be effective for treating patients with recurrent, advanced or metastatic ER positive endometrial cancer.