Bring a large pot of salted water to a boil. Cook the pasta according to package directions. Drain and place in a large bowl.
Heat a grill over high heat. Sprinkle 1 tsp. oil over the Andouille sausage. Grill until nicely charred on one side (about 3 minutes), then turn and repeat on the other side.
Lower heat to medium and continue to cook, turning from time to time until the sausage is cooked through (about 10 minutes all together). When cool enough to handle, chop sausage and place in the bowl with the pasta.
Put the grill back over high heat. Toss the peppers and onion with the remaining oil. Season with salt and pepper and grill until softened and lightly charred (about 5 minutes). When cool enough to handle, roughly chop the vegetables. Place in the bowl.
In a small bowl, whisk together the mayonnaise, yogurt, thyme and hot sauce. Stir into the pasta bowl. Add the beans.
Stir everything together. Taste and adjust seasoning.