Before jumping on to any conclusion for keeping celibacy or not during sadhana we need to understand the basic reason because of which it is said to keep celibacy during sadhana/pooja. Then if the reason makes sense to you then keep it.
The main reason is related to the level of energy which is required for success of any pooja or sadhana. The higher level of energy you will have, the higher chances you will have to get success in any pooja / sadhna. When we meditate, with time we start concentrating on our first chakra ( Mulaadhar Chakra ), we want it or not ultimately slowly slowly our concentration moves towards first chakra. This happens as we are working on a process which is energy thirsty and the source of energy lies at our first chakra.
So, we get flux of energy from first chakra, this is clear now. Let us understand second and related fact. When we practice celibacy we conserve our “Mojo” or “Fluid of Life”. This is something which gives us power. When we conserve our Mojo we can feel the sensation at first chakra ( the part between penis and anal pore ) easily so that is where the Mojo help us. It helps us to feel the sensation easily, but if your body is so tuned via yoga and meditation that you can feel that sensation without conserving your Mojo then I think you are good that ways as well. This sensation is mandatory for success, as this sensation will grow in the form of channel of energy in our back bone (via ida, pingla and sushumna nadis) for energy to pass from our mulaadhar to our brain and this integrated channel makes us winner in any process.
Keeping celibacy is a tradition, if you want to follow the same as tradition then this is perfectly fine. But if you want to see the concept from the aspects of energy and/or core tantra then keeping celibacy is not always necessary. Some times this is required by the process, For example when we are doing pooja of Lord Hanuman keeping celibacy is mandatory, because the chants of Lord Hanumaan contains seed letters “HAM” and “HUM” and when we recite these seed letters the energy generated by the recitation need a support of good amount of Mojo to absorb the energy, or else we might fall sick. Apart from these kind of critical situations keeping celibacy is simply a matter of human power/choice.
If your body has the capacity to feel the thrust of power from first chakra without keeping celibacy you are perfectly fine ( but this state can be attained after a long practice of yoga and meditation, this situation can be called as partially or fully activated mulaadhaar chakra ). But if not then for best results from puja / saadhna we shall practice celibacy.
Another aspect of this is for how long we shall practice celibacy. Some people keep celibacy for the duration of the pooja only. Is this really effective or merely fulfilling the rituals. Keeping celibacy for the duration of any specific pooja only will not help you. If you really need to get the benefits of the power of celibacy then start practicing celibacy at least 2 months before the scheduled date of pooja / saadhna. The duration of 2 months will conserve the required amount of Mojo in your body which is perfectly fine to give you a thrust of energy.
Feel free to revert back for any queries on this.