- Empirical Software Engineering Blog

---

Empirical Software Engineering - Empirical Software Engineering (ESE) is all about finding what works well versus what just feels right. We do ESE to protect ourselves from thought leaders and other predators.

Empirical Software Engineering (ESE) represents a systematic application of empirical and experimental techniques in software engineering. It involves the observation, modeling, and analysis of software engineering artifacts, practices, and methods through real-world experimentation and observation. Unlike some traditional or intuitive approaches, ESE strives to base conclusions on concrete evidence and data-driven insights, aiming to discern what truly works as opposed to what merely feels right or is widely accepted without empirical backing.

The primary objective of ESE is to enhance the quality, productivity, and sustainability of software development. By adopting a data-driven approach, ESE seeks to mitigate risks, reduce uncertainties, and challenge prevailing assumptions that might not hold under scrutiny.

Methods and Techniques

- Experiments: Conducting controlled experiments to evaluate methods, tools, or practices, isolating variables to understand their effects.

- Observation: Observing real-world projects to understand behavior and trends, instead of blindly following principles and patterns.

- Case Studies: Investigating particular instances or projects in-depth to derive generalizable insights, instead of making assumptions.

- Interviews: Gathering insights from practitioners, researchers, and stakeholders to understand opinions, practices, and needs.

- Simulation: Modeling and simulating complex software engineering processes to explore different scenarios and effects.

Benefits and drawbacks

The ESE addresses the risks of blindly following industry trends or opinions that might not be based on solid evidence. In the software engineering field, charismatic thought leaders may promote methods or tools without empirical support. ESE aims to challenge such assertions with systematic evaluation, potentially debunking or refining these ideas. ESE is not without challenges. Conducting robust empirical studies can be resource-intensive and may sometimes yield results that are difficult to generalize. Critics also argue that empirical studies might not always capture the complexities of real-world software engineering.

Empirical Software Engineering (ESE) offers a robust and evidence-based approach to software engineering. By prioritizing empirical observations, controlled experiments, and careful analysis, ESE aspires to cut through hype and unverified claims, grounding the practice of software engineering in verifiable facts. It can be seen as a safeguard against uncritical acceptance of methods, promoting a culture of inquiry and continuous improvement within the software engineering community. Its application continues to be an essential aspect of modern software development, pushing the field towards more rational and effective practices.