Heat olive oil over medium heat in a 3 quart skillet. Add chopped bacon and cook until crisp and evenly browned. Remove bacon using a slotted spoon and place on a paper towel lined plate to drain. Pour off all but two tablespoons of the bacon fat from pan.
Season chicken breasts on both sides and pat dry. Brown chicken breasts in bacon fat over medium high heat on both sides. Chicken will not be cooked through at this point. Remove chicken from pan and set aside.
Reduce heat and add garlic. Sauté garlic in remaining bacon fat, if the pan is a little dry add more bacon fat or olive oil, then add chicken broth to pan and increase heat to high. Scrape bottom of pan to deglaze. Once broth is simmering, stir in uncooked pasta and top with chicken breasts.
Reduce heat to medium low and cover. Cook for 8 minutes. After 8 minutes, remove lid and add broccoli florets to top. Cover again and continue cooking for another 12 minutes or until pasta and broccoli are tender. Remove chicken breasts and stir in evaporated milk followed by shredded cheese. Add additional salt and pepper to taste. Dice chicken breasts. Add diced chicken and crispy bacon to mac and cheese and serve.