Software performance engineering in simple words

Повышение производительности клиентской части сайта с высокой нагрузкой

noreply@blogger.com (Andrey Melnyk) — Fri, 26 Jul 2013 21:21:00 +0000

Евгений Чигиринский рассказывает о технологии измерения и оптимизации производительности сайта за счет статики (CSS, JS, etc). Опыт и реализация на примере MSN.COM.

Computer systems performance analysis

noreply@blogger.com (Andrey Melnyk) — Mon, 29 Apr 2013 14:18:00 +0000

Большая часть книги R. Jain, "The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling" доступна в формате видео лекций и слайдов на странице автора здесь.

Performance Testing Java Applications

noreply@blogger.com (Andrey Melnyk) — Thu, 04 Apr 2013 13:39:00 +0000

Performance Testing Java Applications

Extreme Performance with Java

noreply@blogger.com (Andrey Melnyk) — Tue, 07 Aug 2012 10:20:00 +0000

http://www.infoq.com/presentations/Extreme-Performance-Java

e-book: Measuring Computer Performance

noreply@blogger.com (Andrey Melnyk) — Sat, 21 Apr 2012 19:04:00 +0000

Measuring Computer Performance sets out the fundamental techniques used in analyzing and understanding the performance of computer systems. The emphasis is on practical methods of measurement, simulation, and analytical modeling. The book discusses performance metrics and provides detailed coverage of the strategies used in benchmark programs. In addition to intuitive explanations of key statistical tools, the general "design of experiments" technique is described to show how the maximum amount of information can be obtained with minimum effort. Features include appendices listing common probability distributions and statistical tables and a glossary of important technical terms.

Contents:
1 - Introduction
2 - Metrics of performance
3 - Average performance and variability
4 - Errors in experimental measurements
5 - Comparing alternatives
6 - Measurement tools and techniques
7 - Benchmark programs
8 - Linear-regression models
9 - The design of experiments
10 - Simulation and random-number generation
11 - Queueing analysis

Download Measuring Computer Performance e-book

Please be informed all books are provided for familiarization purposes. Please consider purchasing the book.

e-book: Oracle Database 11gR2 Performance Tuning Cookbook

noreply@blogger.com (Andrey Melnyk) — Fri, 10 Feb 2012 16:21:00 +0000

Achieve better performance from your Oracle Database applications

Learn the right techniques to achieve best performance from the Oracle Database
Avoid common myths and pitfalls that slow down the database
Diagnose problems when they arise and employ tricks to prevent them
Explore various aspects that affect performance, from application design to system tuning

In Detail Oracle's Database offers great performance, scalability, and many features for DBAs and developers. Due to a wide choice of technologies, successful applications are good candidates to run into performance issues and when a problem arises it's very difficult to identify the cause and the right solution to the problem.

The Oracle Database 11g R2 Performance Tuning Cookbook helps DBAs and developers to understand every aspect of Oracle Database that can affect performance. You will be guided through implementing the correct solution in a proactive way before problems arise, and how to diagnose issues on your Oracle database-based solutions.

This fast-paced book offers solutions starting from application design and development, through the implementation of well-performing applications, to the details of deployment and delivering best-performance databases.

With this book you will quickly learn to apply the right methodology to tune the performance of an Oracle Database, and to optimize application design and SQL and PL/SQL code. By following the real-world examples you will see how to store your data in correct structures and access and manipulate them at a lightning speed. You will learn to speed up sort operations, hack the optimizer and the data loading process, and diagnose and tune memory, I/O, and contention issues.

The purpose of this cookbook is to provide concise recipes, which will help you to build and maintain a very high-speed Oracle Database environment.

Effectively apply performance tuning principles with concise recipes

What you will learn from this book

Design applications that run at lightning speed
Implement fast and scalable SQL and PL/SQL code
Choose the correct structures to store the data and access them
Optimize sort operations, such as order-by, Top-N queries, ranking, and set operators
Help the optimizer to choose the right access plan to retrieve data at the best available speed
Load data in the database at a faster speed by using the correct tools and options
Tune the database memory to obtain maximum performance using available resources
Tune the I/O operations, by designing a database over the I/O system
Tune and reduce contention issues on data and structures by using an optimal design

Approach

In this book you will find both examples and theoretical concepts covered.

Every recipe is based on a script/procedure explained step-by-step, with screenshots, while theoretical concepts are explained in the context of the recipe, to explain why a solution performs better than another.

Who this book is written for

This book is aimed at software developers, software and data architects, and DBAs who are using or are planning to use the Oracle Database, who have some experience and want to solve performance problems faster and in a rigorous way.

If you are an architect who wants to design better applications, a DBA who is keen to dig into the causes of performance issues, or a developer who wants to learn why and where the application is running slow, this is the book for you.

Basic knowledge of SQL language is required and general knowledge of the Oracle Database architecture is preferable.

Download Oracle Database 11gR2 Performance Tuning Cookbook

Please be informed all books are provided for familiarization purposes. Please consider purchasing the book.

e-book: Web Performance Insights 2011

noreply@blogger.com (Andrey Melnyk) — Thu, 02 Feb 2012 11:35:00 +0000

http://www.onlineprogrammingbooks.com/web-performance-insights-2011/

MIT: Performance Engineering of Software Systems

noreply@blogger.com (Andrey Melnyk) — Mon, 26 Dec 2011 16:13:00 +0000

http://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-172-performance-engineering-of-software-systems-fall-2010/

IBM WebSphere Portal Performance Troubleshooting Guide

noreply@blogger.com (Andrey Melnyk) — Thu, 27 Oct 2011 08:32:00 +0000

Отличное руководство для тех, кто хочет научиться траблшутить проблемы с производительностью веб приложений. Несмотря на то, что документ описывает процесс локализации узких мест для продукта IBM WebSphere Portal, подходы и техники описанные в документе применимы к большинству веб приложений.
Download IBM WebSphere Portal Performance Troubleshooting Guide

MySQL. Оптимизация производительности 2-е издание

noreply@blogger.com (Andrey Melnyk) — Mon, 12 Sep 2011 07:24:00 +0000

Авторы этой книги - известные специалисты с многолетней практикой - рассказывают о том, как создавать быстрые и надежные системы на основе MySQL. Ими подробно описываются различные нетривиальные подходы, которые позволят задействовать всю мощь этой СУБД. Рассматриваются методы проектирования схем, индексов и запросов для достижения максимальной производительности. Предлагаются детальные указания по настройке сервера MySQL, операционной системы и оборудования для полного раскрытия их потенциала. Описаны безопасные способы масштабирования приложений, основанные на репликации и балансировании нагрузки. Второе издание полностью переработано и существенно дополнено, особое внимание уделено отказоустойчивости, безопасности и обеспечению целостности данных. Книга рекомендуется как новичкам, так и опытным пользователям, которые хотели бы увеличить производительность своих приложений на базе MySQL. Скачать MySQL. Оптимизация производительности 2-е издание

e-Book: Oracle Performance Tuning with Solid State Disk by Mike Ault

noreply@blogger.com (Andrey Melnyk) — Thu, 02 Jun 2011 14:49:00 +0000

Free ebook "Oracle Performance Tuning with Solid State Disk" by Oracle expert Mike Ault, with contributions from Jamon Bowen, Joe Bromley, and Matt Key, all experts on solid state disk (SSD) technology. The increasing popularity of solid state disks is challenging DBAs to adapt their database performance tuning methodologies in order to optimize application performance and return on investment. This new book delivers up-to-the-minute practical guidance that empowers DBAs to target SSD technology to those database areas that will benefit most.

Download Oracle Performance Tuning with Solid State Disk

White Paper: Increase Application Performance with Solid State Disk

noreply@blogger.com (Andrey Melnyk) — Thu, 02 Jun 2011 14:43:00 +0000

A white paper presents solid state disk technology as a cost-effective way to improve application performance. This includes a comparison of methods for increased performance and third-party verification of Texas Memory Systems' claim to The World's Fastest Storage®.

Download Increase Application Performance with Solid State Disk white paper

[e-book] Enterprise Network Testing

noreply@blogger.com (Andrey Melnyk) — Fri, 29 Apr 2011 10:37:00 +0000

The complete guide to using testing to reduce risk and downtime in advanced enterprise networks. Testing has become crucial to meeting enterprise expectations of near-zero network downtime. Enterprise Network Testing is the first comprehensive guide to all facets of enterprise network testing. Cisco enterprise consultants Andy Sholomon and Tom Kunath offer a complete blueprint and best-practice methodologies for testing any new network system, product, solution, or advanced technology.
Enterprise Network Testing contains easy-to-adapt reference test plans for branches, WANs/MANs, data centers, and campuses. The authors also offer specific guidance on testing many key network technologies, including MPLS/VPN, QoS, VoIP, video, IPsec VPNs, advanced routing (OSPF, EIGRP, BGP), and Data Center Fabrics.

* Understand why, when, and how you should test your network
* Use testing to discover critical network design flaws
* Incorporate structured systems testing into enterprise architecture strategy
* Utilize testing to improve decision-making throughout the network lifecycle
* Develop an effective testing organization and lab facility
* Choose and use test services providers
* Scope, plan, and manage network test assignments
* Leverage the best commercial, free, and IOS test tools
* Successfully execute test plans, including crucial low-level details
* Minimize the equipment required to test large-scale networks
* Identify gaps in network readiness
* Validate and refine device configurations
* Certify new hardware, operating systems, and software features
* Test data center performance and scalability
* Leverage test labs for hands-on technology training

Download Enterprise Network Testing: Testing Throughout the Network Lifecycle to Maximize Availability and Performance e-book

The obscure world of performance requirements by Alex Podelko

noreply@blogger.com (Andrey Melnyk) — Mon, 18 Apr 2011 10:09:00 +0000

Quote:"The last version of my performance requirements presentation (from yesterday's CT CMG) http://bit.ly/fy114f"

[CMG'10 Video Session]Performance Engineering Parables

noreply@blogger.com (Andrey Melnyk) — Mon, 11 Apr 2011 15:29:00 +0000

Part 1

Part 2

e-book High Performance Computing

noreply@blogger.com (Andrey Melnyk) — Tue, 22 Feb 2011 14:09:00 +0000

Contents:

1 What is High Performance Computing?
1.1 Introduction to the Connexions Edition
1.2 Introduction to High Performance Computing

2 Memory
2.1 Introduction
2.2 Memory Technology
2.3 Registers
2.4 Caches
2.5 Cache Organization
2.6 Virtual Memory
2.7 Improving Memory Performance
2.8 Closing Notes
2.9 Exercises

3 Floating-Point Numbers
3.1 Introduction
3.2 Reality
3.3 Representation
3.4 Effects of Floating-Point Representation
3.5 More Algebra That Doesn't Work
3.6 Improving Accuracy Using Guard Digits
3.7 History of IEEE Floating-Point Format
3.8 IEEE Operations
3.9 Special Values
3.10 Exceptions and Traps
3.11 Compiler Issues
3.12 Closing Notes
3.13 Exercises

4 Understanding Parallelism
4.1 Introduction
4.2 Dependencies
4.3 Loops
4.4 Loop-Carried Dependencies
4.5 Ambiguous References
4.6 Closing Notes
4.7 Exercises

5 Shared-Memory Multiprocessors
5.1 Introduction
5.2 Symmetric Multiprocessing Hardware
5.3 Multiprocessor Software Concepts
5.4 Techniques for Multithreaded Programs
5.5 A Real Example
5.6 Closing Notes
5.7 Exercises

6 Programming Shared-Memory Multiprocessors
6.1 Introduction
6.2 Automatic Parallelization
6.3 Assisting the Compiler
6.4 Closing Notes
6.5 Exercises

Download e-book High Performance Computing

LoadRunner student workbook

noreply@blogger.com (Andrey Melnyk) — Fri, 11 Feb 2011 14:15:00 +0000

Учебник для начинающих c примерами и вопросами для самопроверки.
Download LoadRunner student workbook

How to use Performance Monitor and Profiler to trace SQL Server's performance by Brent Ozar

noreply@blogger.com (Andrey Melnyk) — Tue, 18 Jan 2011 16:11:00 +0000

For more information on the topic of this post go to:
http://www.brentozar.com/sql/sql-server-performance-tuning/

Pro PHP Application Performance: Tuning PHP Web Projects for Maximum Performance

noreply@blogger.com (Andrey Melnyk) — Mon, 10 Jan 2011 17:33:00 +0000

Book summary:
Pro PHP Application Performance: Tuning PHP Web Projects for Maximum Performance by Armando Padilla and Tim Hawkins

This book contains tips, tricks, and techniques to make new and existing PHP applications much faster and less resource-hungry. Author Armando Padilla looks at all major sections of the PHP application stack—from server hardware to database and web server performance. PHP program application performance is the center of this book, and Padilla shows you how to improve performance by best practices, proper design, and best-of-breed tools.

Padilla starts out by establishing performance testing and benchmarking methodology using common open source and browser-based testing tools. He then discusses best practices for PHP development, and also explains refactoring existing code, both with performance in mind. In addition to best coding practices, this book will teach you how to use and tweak Opcode caches such as APC, XCache, and eAccelerator.

Padilla then highlights how to support the efficient running of PHP applications, tweaks and settings by taking advantage of the GNU/Linux and Microsoft Windows operating systems to improve hosting performance and reliability. Additional tips on web server improvements and database administration help round out the picture. Finally, Padilla presents some hardware example configurations tuned for high performance.
What you’ll learn

* How to improve the performance of existing PHP applications
* How to maximize the performance of existing operating systems and databases
* How to refactor existing PHP code for better performance
* How to identify and rectify bottlenecks in PHP code
* How to take advantage of variable caching to increase performance
* Strategies for selecting server hardware for best performance

Who this book is for:

This books will appeal to established PHP developers who wish to write new, complex applications or want to rearchitect existing ones. Developers of other languages such as Ruby, Python, and VB.NET will also have an interest in the techniques for tuning the performance of web servers, databases, and operating systems.

Download e-Book Pro PHP Application Performance: Tuning PHP Web Projects for Maximum Performance

Free eBook: SQL Server Statistics

noreply@blogger.com (Andrey Melnyk) — Tue, 04 Jan 2011 16:31:00 +0000

A great explanation and examples of how the statistics impact a query execution plan efficiency.

Book summary:
Holger Schmeling’s work in SQL Server Distribution Statistics was first published as a pair of long articles for Simple-Talk. The booklet takes a practical, and well-informed approach to a subject that is not always easy to explain or understand. A Distribution Statistics object is a sampled map of the distribution of data in a table. Such statistics help the Query Optimizer of SQL Server’s Database Engine to translate the ‘logical’ SQL Query into the best strategy for doing all the physical operations of joining, sorting, and selecting the data. Most of the time, this work happens effectively without the database administrator having to be aware of what is going on, but occasionally, if the statistics no longer reflect what is actually in the table, then queries can suddenly run grindingly slow. At this point, the DBA must intervene to correct the problem.

Download ebook SQL Server Statistics

Software performance test engineer opportunity for Sky project (IRC1517)

noreply@blogger.com (Andrey Melnyk) — Wed, 08 Dec 2010 13:04:00 +0000

GlobalLogic Ukraine in partnership with Sky is opening a position of Software Performance Test Engineer to work on a full-time basis in Kyiv office.

One of the world's largest broadcasters, Sky is driving a fresh and inspiring approach to entertainment. A FTSE top 30 company with more than nine million subscribers, we're seen in one out of every three UK homes. Now, with ambitious plans for growth, we're taking our success still further - and we need you to drive our exciting future in this key role.

Responsibilities include:

- Driving business critical testing efforts to ensure performance, reliability and scalability of a large web-based system
- Developing user behavior models for performance testing
- Conducting performance, load, endurance tests to ensure the performance and stability of large multi-tier web applications
- Analyzing performance test results, diagnosing bottlenecks and working closely with engineers to identify solutions.
- Overseeing the application performance lifecycle from the performance lab all the way through to production
- Providing data collection and trend analysis
- Providing regular reports on the performance characteristics of the systems

The ideal candidate should have:

- Bachelor's degree in Computer Science or equivalent experience
- Good working knowledge of non-functional testing including: performance, security, network, disaster recovery etc.
- 2+ years professional technical experience in performance testing/engineering
- Experience performing planning and performance testing for large enterprise system
- Experience using performance testing tools, preferably HP Performance Center, LoadRunner(Web(HTTP/HTML) protocol).

Strong "Plus" if familiar with:
- Operating system design/tuning (e.g. Windows, Solaris, AIX)
- Database tuning and administration (e.g. MSSQL, Oracle, DB2)
- Application servers (e.g. Weblogic, WebSphere etc.)
- TCP/IP, networking topology, routers, switches
- Network packet sniffers
- J2EE Technologies (e.g. JSP, Servlets, EJB, JNDI)
- Programming (e.g. Java, C++, C)

Our team consists of creative and talented people who are passionate about their work. We offer a casual, fast-paced, collaborative environment that stimulates ideas and innovation. You will find comfortable offices packed with features and happy, friendly and professional people. Paid vacation and sick leave, medical insurance and performance bonus program are included.

GlobalLogic Contact Center:

Tel.: 0 800 30 6999

Skype: globallogic.contact.center

ICQ: 621 047 897

PostgreSQL 9.0 High Performance

noreply@blogger.com (Andrey Melnyk) — Mon, 29 Nov 2010 09:54:00 +0000

Accelerate your PostgreSQL system

* Learn the right techniques to obtain optimal PostgreSQL database performance, from initial design to routine maintenance.
* Discover the techniques used to scale successful database installations.
* Avoid the common pitfalls that can slow your system down.
* Filled with advice about what you should be doing; how to build experimental databases to explore performance topics, and then move what you've learned into a production database environment.
* Covers versions 8.1 through 9.0.

In Detail

PostgreSQL database servers have a common set of problems they encounter as their usage gets heavier and requirements more demanding. You could spend years discovering solutions to them all, step by step as you encounter them. Or you can just look in here.

All successful database applications are destined to eventually run into issues scaling up their performance. Peek into the future of your PostgreSQL database's problems today. Know the warning signs to look for, and how to avoid the most common issues before they even happen.

Surprisingly, most PostgreSQL database applications evolve in the same way: Choose the right hardware. Tune the operating system and server memory use. Optimize queries against the database, with the right indexes. Monitor every layer, from hardware to queries, using some tools that are inside PostgreSQL and others that are external.

Using monitoring insight, continuously rework the design and configuration. On reaching the limits of a single server, break things up; connection pooling, caching, partitioning, and replication can all help handle increasing database workloads.

The path to a high performance database system isn't always easy. But it doesn't have to be mysterious with the right guide.

A clear, step-by-step guide to optimizing and scaling up PostgreSQL database servers

What you will learn from this book

* How to implement PostgreSQL features for reliability and performance
* How to use the latest PostgreSQL 9.0 features
* Summaries to help DBAs with experience of other database systems
* Advanced technical tips and scripts for experienced users
* Best practice for planning and designing live databases.
* How and when to VACUUM your databases.
* Selecting and implementing robust backup techniques.
* Concise and clear guidance on replication and high availability.

Approach

Written in the cookbook style, this book offers learning and techniques through recipes. It contains step-by-step instructions for administrators and developers to manage databases on PostgreSQL. The book is designed in such a way that you can read it chapter by chapter or refer to recipes in no particular order.

Who this book is written for

This book is for Sysadmins, Database Administrators, Architects, Developers, and anyone with an interest in planning for or running live production databases. This book is most suited to those who have some technical experience.

Download PostgreSQL 9.0 High Performance book

ASP.NET Site Performance Secrets

noreply@blogger.com (Andrey Melnyk) — Sat, 27 Nov 2010 11:27:00 +0000

Simple and proven techniques to quickly speed up your ASP.NET website

* Speed up your ASP.NET website by identifying performance bottlenecks that hold back your site's performance and fixing them
* Tips and tricks for writing faster code and pinpointing those areas in the code that matter most, thus saving time and energy
* Drastically reduce page load times
* Configure and improve compression - the single most important way to improve your site's performance
* Written in a simple problem-solving manner - with a practical hands-on approach and just the right amount of theory you need to make sense of it all

In Detail

Do you think that only experts with a deep understanding of the inner workings of ASP.NET, SQL Server, and IIS can improve a website's performance? Think again - because this book tosses that notion out of the window. It will help you resolve every web developer's nightmare - a slow website - with angry managers looking over your shoulder, raging calls from advertisers and clients - the lot. You don't have the time or energy to gain a thorough and complete understanding of ASP.NET performance optimization - You just need your site to run faster! This book will show you how.

This hands-on book shows how to dramatically improve the performance of your ASP.NET-based website straight away, without forcing you through a lot of theoretical learning. It teaches you practical, step-by-step techniques that you can use right away to make your site faster with just the right amount of theory you need to make sense of it all.

Start reading today and you could have a faster website tomorrow.

Unlike other performance-related books, here you'll first learn how to pinpoint the bottlenecks that hold back your site's performance, so you can initially focus your time and energy on those areas of your site where you can quickly make the biggest difference. It then shows you how to fix the bottlenecks you found with lots of working code samples and practical advice, and just the right amount of theoretical detail.

The first chapter details techniques for diagnosing performance issues using Waterfall charts. Subsequent chapters then each focus on one individual aspect of your website, providing you with numerous real-life scenarios and performance-enhancing techniques for each of them. In the last chapter, you learn how to effectively load-test your environment in order to measure the change in performance of your site without having to update your production environment - whether it is a new release or simply a small change in the database.

What you will learn from this book

* Learn how to pinpoint and fix bottlenecks relating to all aspects of your site - server side, client side, code, images, and database.
* Ensure shorter wait times for your site.
* Eliminate the need to hire a DBA, by speeding up database access using insight into index structures and other advanced techniques.
* Drastically speed up image loading, by exploiting browser behavior and by removing the hidden overhead in each image file.
* Use ASP.NET's caching feature to dramatically improve performance by adding just a few lines of code.
* Prevent a little known bottleneck overlooked by most developers - a shortage of worker threads in IIS - by using asynchronous methods.
* Enable compression in IIS 6 and IIS 7 to cut file transfer times and bandwidth costs.
* Reduce your Memory and CPU usage.
* Optimize the deployment and usage of forms on your website.
* Speed up JavaScript and CSS loading.
* Diagnose problems as they occur, using waterfall charts.
* Load-test your environment to measure the level of improvement in performance.
* Find heaps of reference links and descriptions of free and low cost tools and services that make it easy to spot performance issues right away.

Approach

Written in a practical and clear conversational style, this book is filled with real-life website performance scenarios. It is replete with lots of working code samples and practical advice, and just the right amount of theory you need to make sense of it all.

Download book

Рекомендовано к использованию: MSSQL Server 2005 performance dashboard reports

noreply@blogger.com (Andrey Melnyk) — Tue, 16 Nov 2010 16:33:00 +0000

После установки MS SQL 2005/2008 в perfmon добавляется много различных счетчиков мониторинга состояния сервера и баз данных. Эти счетчики дают хорошее представление о том что происходит с базой данных и сервером но они не дают практически никакого представления о том, что происходит на уровне запросов, а именно, нету корреляции между каким-то конкретным sql запросом и значением счетчика. Добавьте к этому еще волокиту с анализом логов perfmon, отсутсвие механизма корряляции значений счетчиков между собой. Очевидным также есть тот факт, что одной из наиболее частых проблем на стороне базы данных есть недооптимизированные запросы и отсутствие индексов, поэтому решения для мониторинга внутреннего состояния\активностей базы данных очень важны.

Для потребностей администраторов баз данных MS SQL Server был разработан своего рода add-on(reporting services), который называется Performance Dashboard Reports. Основная функция PDR это мониторинг SQL запросов и рекомендации по улучшению их производительности(например, посредством добавления индексов). Характерной особенностью MS SQL Server есть дружелюбный интерфейс, это свойство было унаследовано и в PDR отчего использовать эти отчеты в удовольствие unlike оракл.

Скачать дистрибутив можно на родном сайте, детально инсталляция описана здесь.

Cross-post: How to fix memory leaks in java

noreply@blogger.com (Andrey Melnyk) — Tue, 09 Nov 2010 17:47:00 +0000

How to fix memory leaks in java