Difference between revisions of "Analytica User Group"
m (typo) |
|||
Line 28: | Line 28: | ||
<b>Abstract</b> | <b>Abstract</b> | ||
− | The [[RunConsoleProcess] function runs an external program, can exchange data with that program, and can be used to perform a computation or acquire data outside of Analytica, that then can be used within the model. I'll demonstrate how this can be used with a handful of programs, and code written in several programming and scripting languages. I'll demonstrate a user-defined function that retrieves historical stock data from a web site. | + | The [[RunConsoleProcess]] function runs an external program, can exchange data with that program, and can be used to perform a computation or acquire data outside of Analytica, that then can be used within the model. I'll demonstrate how this can be used with a handful of programs, and code written in several programming and scripting languages. I'll demonstrate a user-defined function that retrieves historical stock data from a web site. |
=== The [[Using_References|Reference and Dereference Operators]] === | === The [[Using_References|Reference and Dereference Operators]] === |
Revision as of 20:44, 11 October 2007
The Analytica User Group provides a support system and various resources among existing Analytica Users.
Webinar Series
The Analytica webinar series uses GotoMeeting with conference calling technology as a media for regular presentations on topics of potential interest to the community of Analytica users and modelers. Webinars are interactive, with questions and tangents welcome. Webinars are a great place to learn more about Analytica and other related topics! Seats are limited. To sign up for a particular webinar, see "How to Attend" below.
Topic scope includes:
- Introduction to new Analytica 4.0 features.
- How-to: How to utilize specific Analyica features.
- Case-studies: Presentation about successful applications.
- General modeling topics. E.g., an introduction to XYZ theory, and modeling this in Analytica.
- Analytica training.
In the upcoming weeks, we expect to offer several webinars covering features new to Analyica 4.0.
Webinar presentations may last anywhere from 20 to 90 minutes, depending on the topic (an estimate of duration should be included with the topic).
Lumina may record make a recording of User Group webinars, including audio of the presenter and participants. Lumina reserves the right to make these recordings available (or not) at its discretion.
Schedule of Upcoming Webinars
Calling External Applications
Date and Time: Thursday, Oct 18, 2007 at 10:00 - 11:00am Pacific Daylight Time
Presenter: Lonnie Chrisman, Lumina Decision Systems
Abstract
The RunConsoleProcess function runs an external program, can exchange data with that program, and can be used to perform a computation or acquire data outside of Analytica, that then can be used within the model. I'll demonstrate how this can be used with a handful of programs, and code written in several programming and scripting languages. I'll demonstrate a user-defined function that retrieves historical stock data from a web site.
The Reference and Dereference Operators
The reference operators make it possible to represent complex data structures like trees or non-rectangular arrays, bundle heterogenous data into records, maintain arrays of local indexes, and seize control of array abstraction in a variety of scenarios. Using a reference, an array can be made to look like an atomic element to array abstraction, so that arrays of differing dimensionality can be bundled into a single array without an explosion of dimensions. The flexibilities afforded by references are generally for the advanced modeler or programmer, but once mastered, they come in useful fairly often.
The Iterate Function
With Iterate, you can create a recurrent loop around a large model, which can be useful for iterating until a convergence condition is reached, for example. For complex iterations, where many variables are being updated at each iteration, requires you to structure your model appropriate, bundling and unbundling values within the single iterative loop. With some work, Iterate can be used to simulate the functionality Dynamic, and thus provides one option when a second Time-like index is needed (although not nearly as convenient as Dynamic).
In this session, we'll explore how Iterate can be used.
Modeling Energy Efficiency in Large Data Centers
Date and TimeThursday, Oct 25, 2007 at 10:00 - 11:00am Pacific Daylight Time
Presenter:Surya Swamy, Lumina Decision Systems
Abstract
The U.S. data center industry is witnessing a tremendous growth period stimulated by increasing demand for data processing and storage. This has resulted in a number of important implications including increased energy costs for business and government, increased emissions from electricity generation, increased strain on the power grid and rising capital costs for data center capacity expansion. In this webinar, Analytica's dynamic modeling capabilities coupled with it's advanced uncertainty capabilities, which offer tremendous support in building cost models for planning and development of energy efficient data centers will be illustrated. The model enables users to explore future technologies, the performance, costs and efficiencies of which are uncertain and hence to be probabilistically evaluated over time.
Handles and Meta-Inference
Date and Time: TBA
Presenter: Lonnie Chrisman, Lumina Decision Systems
Abstract
Meta-inference refers to computations that reason about your model itself, or that actually alter your model. For example, if you were to write an expression that counted how many variables are in your model, you would be reasoning about your model. Other examples of meta inference include changing visual appearance of nodes to communicate some property, re-arranging nodes, finding objects with given properties, or even creating a transformed model based on portion of your model's structure.
The ability to implement meta-inferential algorithms in Analytica has been greatly enhanced in Analytica 4.0. The key to implementation of meta-inference is the manipulation of Handles to objects (formerly refered to as varTerms). This webinar will provide a very brief introduction to handles and using them from within expressions. I will assume you are pretty familiar with creating models and writing expressions in Analyica, but I will not assume that have previous seen or used Handles.
How to Attend
To attend, you need to sign up by contacting Lumina at webinars@lumina.com or (650) 212-1212. Attendence is limited to 15 people, so don't sign up unless you sincerely intend to attend. Also, sign up at least a day prior, since the webinar may be cancelled if there are few pre-registered participants.
These Webinars are FREE to users who have an up-to-date annual maintenance subscription (MTS). If you are unsure, check with mailto:sales@lumina. For those without MTS, an attendence fee of US$100 is charged.
How to be a Presenter
Being a presenter at an Analytica webinar provides an opportunity to make others in the Analytica community aware of your successes or capabilities. Consultants may find this an opportunity for exposure to others with particular modeling needs. Also, if you are an Analytica aficionado, this is a great opportunity to help others.
If you would like to be a presenter, submit your proposed topic to webinars@lumina.com and possible presentation times (include the time zone). We will schedule the GotoMeeting conference (you do not need a gotoMeeting subscription yourself) and we will make you presenter during the session, allowing you to share your screen while you talk. You will most likely make use of Power Point and a running Analytica during your presentation.
Past Topics
Introduction to Linear and Quadratic Programming
Date and Time: Thursday, Oct 11, 2007 at 10:00 - 11:00am Pacific Daylight Time
Presenter: Lonnie Chrisman, Lumina Decision Systems
Abstract
This talk is an introduction to linear programming and quadratic programming, and an introduction to solving LPs and QPs from inside an Analytica model (via Analytica Optimizer). LPs and QPs can be efficiently encoded using the Analytica Optimizer functions LpDefine and QpDefine. I'll introduce what a linear program is for the sake of those who are not already familiar, and examine some example problems that fit into this formalism. We'll encode a few in Analytica and compute optimal solutions. Although LPs and QPs are special cases of non-linear programs (NLPs), they are much more efficient and reliable to solve, avoid many of the complications present in non-linear optimization, and fully array abstract. Many problems that initially appear to be non-linear can often be reformulated as an LP or QP. We'll also see how to compute secondary solutions such as dual values (slack variables and reduced prices) and coefficient sensitivies. Finally, LpFindIIS can be useful for debugging an LP to isolate why there are no feasible solutions.
You can watch a recording of this webinar here: LP-QP-Optimization.wmv (requires Windows Media Player)
The model file created during this webinar is here: LP QP Optimization.ana
Non-Linear Optimization
Date and Time: Thursday, Oct 4, 2007 at 10:00 - 11:00am Pacific Daylight Time
Presenter: Lonnie Chrisman, Lumina Decision Systems
Abstract
This talk focuses on the problem of maximizing or minimizing an objective criteria in the presence of contraints. This problem is referred to as a non-linear program, and the capability to solve problems of this form is provided by the Analytica Optimizer via the NlpDefine function. In this talk, I'll introduce the use of NlpDefine for those who have not previously used this function, and demonstrate how NLPs are structured within Analytica models. I'll examine various challenges inherent in non-linear optimization, tricks for diagnosing these and some ways to address these. We'll also examine various ways in which to structure models for parametric analyses (e.g., array abstraction over optimization problems), and optimizations in the presence of uncertainty.
You can watch a recording of this session here: Nonlinear-Optimization.wmv
During the talk, these two models were created:
Writing User-Defined Functions
Date and Time: Thursday, Sept. 27, 2007 at 10:00 - 11:00am Pacific Daylight Time
Presenter: Lonnie Chrisman, Lumina Decision Systems
Abstract
When you need a specialized function that is not already built into Analytica, never fear -- you can create your own User-Defined Function (UDF). Creating UDFs in Analytica is very easy. I'll introduce this convenient capability, and demonstrate how UDFs can be organized into libraries and re-used in other models. I'll also review the libraries of functions that come with Analytica, providing dozens of additional functions.
After this introduction to the basics of UDFs, I'll dive into an in-depth look at Function Parameter Qualifiers. There is a deep richness to function parameter qualifiers, mastery of which can be used to great benefit. One of the main objectives for a UDF author, and certainly a hallmark of good modeling style, should be to ensure that the function fully array abstracts. Although this usually comes for free with simple algorithms, it is sometimes necessary to worry about this explicitly. I will demonstrate how this objective can often be achieved through appropriate function parameter qualification.
Finally, I will cover how to write a custom distribution function, and how to ensure it works with Mid, Sample and Random.
This talk is appropriate for Analytica modelers from beginning through expert level. At least some experience building Analytica models and writing Analytica expressions is assumed.
The model created during this webinar, complete with the UDFs written during that webinar, can be downloaded here: Writing User Defined Functions.ana.
You can watch this webinar here: Writing-UDFs.wmv (Windows Media Player required)
Modeling Markov Processes in Analytica
Date and Time: Thursday, Sept. 20, 2007 at 10:00 - 11:00am Pacific Daylight Time
Presenter: Matthew Bingham, Principal Economist, Veritas Economic Consulting
Abstract
The class of mathematical processes characterized by dynamic dependencies between successive random variables is called Markov chains. The rich behavior and wide applicability of Markov chains make them important in a variety of applied mathematical applications including population and demographics, health outcomes, marketing, genetics, and renewable resources. Analytica’s dynamic modeling capabilities, robust array handling, and flexible uncertainty capabilities support sophisticated Markov modeling. In this webinar, a Markov modeling application is demonstrated. The model develops age-structured population simulations using a Leslie matrix structure and dynamic simulation in Analytical.
A recording of this session can be viewed at: Markov-Processes.wmv (requires Windows Media Player)
An article about the model presented here: AnalyticaMarkovtext.pdf
Manipulating Dates in Analytica
Date and Time: Thursday, Sept. 13, 2007 at 10:00 - 11:00am Pacific Daylight Time
Presenter: Lonnie Chrisman, Lumina Decision Systems
Abstract
In this talk, I'll cover numerous aspects relating to the manipulation of dates in Analytica. I'll introduce the encoding of dates as integers and the date origin preference. I'll review how to configure input variables, edit tables, or even individual columns of edit tables to accept (and parse) dates as input. I'll cover date number format capabilities in depth, including how to create your own custom date formats, understanding how date formats interact with your computer's regional settings, and how to restrict a date format to a single column only. We'll also see how axis scaling in graphs is date-aware.
Next, we'll examine various ways to manipulate dates in Analytica expressions. This includes use of the new and powerful functions MakeDate, DatePart, and DateAdd, and some interesting ways in which these can be used, for example, to define date sequences. Finally, we'll practice our array mastery by aggregating results to and from different date granularities, such aggregating from a month sequence to a years, or interpolating from years to months.
The model file resulting by the end of the session is available here: Manipulating Dates in Analytica.ana.
You can watch a recording of this webinar here: Manipulating Dates.wmv (Windows Media Player required) Unfortunately, this one seems to have recorded poorly -- the video size is too small. If you magnify it in your media player, it does become readable. Sorry -- I don't know why it recorded like this.
Button Scripting
Date and Time: Thursday, Sept. 6, 2007 at 10:00 - 11:00am Pacific Daylight Time
Presenter: Max Henrion, Lumina Decision Systems
Abstract
This webinar is an introduction to Analytica's typescript and button scripting. Unlike variable definitions, button scripts can have side-effects, and this can be useful in many circumstances. I'll cover the syntax of typescript (and button scripts), and how scripts can be used from buttons, picture nodes or choice inputs. I'll introduce some of the Analytica scripting language to those who may have seen or used it before. And we'll examine some ways in which button scripting can be used.
You can watch the recording of this webinar here: Button Scripting.wmv (Requires Windows Media Player or equiv)
Using Regression
Date and Time: Thursday, Aug 30, 2007 at 10:00 - 11:00am Pacific Daylight Time
Presenter: Lonnie Chrisman, Lumina Decision Systems
Abstract
Regression analysis is a statistical technique for curve fitting, discovering relationships in data, and testing hypotheses between variables. In this webinar, I will focus on generalized linear regression, which is provided by Analytica's Regression function, and examine many ways in which is can be used, including fitting simple lines to data, polynomial regression, use of other non-linear terms, and fitting of autoregressive models (e.g., ARMA). I'll examine how we can assess how likely it is the data might have been generated from the particular form of the regression model used. We can also determine the level of uncertainty in our inferred parameter values, and incorporate these uncertainties into a model that uses the result of the regression. The talk will cover Analytica 4.0 functions Regression, RegressionDist, RegressionFitProb, and RegressionNoise.
The model developed during the course of this session is downloadable from here: Using Regression.ana
Creating Scatter Plots
Date and Time: Thursday, Aug 23, 2007 at 10:00 - 11:00am Pacific Daylight Time
Presenter: Lonnie Chrisman, Lumina Decision Systems
Abstract
This webinar focuses on utilizing graphing functionality new to Analytica 4.0, and specifically, functionality enabling the creative use of scatter plots. The talk will focus primarily on techniques for simultaneously displaying many quantities on a single 2-D graph. I'll discuss several methods in which multiple data sources (i.e., variable results) can be brought together for display in a single graph, including the use of result comparison, comparison indexes, and external variables. I'll describe the basic new graphing-role / filler-dimension structure for advanced graphing in Analytica 4.0, enabling multiple dimensions to be displayed on the horizontal and vertical axes, or as symbol shape, color, or symbol size, and how all these can be rapidly pivoted to quickly explore the underlying data. I'll discuss how graph settings adapt to changes in pivot or result view (such as Mean, Pdf, Sample views).
Model used: During this webinar, I started with some example data in the model Chemical elements.ana. The original file is in the form before graph settings were changed. By the end of the webinar, many graph settings had been altered, and various changes made, resulting in Chemical elements2.ana. These models are very useful for people who didn't attend. For those who did attend, who might want to try repeating the steps involved in setting up scatter plots, I think it is better starting with the original model.
Statistical Functions in Analytica 4.0
Date and Time: Thursday, Aug 16, 2007 at 10:00 - 11:00am Pacific Daylight Time
Presenter: Lonnie Chrisman, Lumina Decision Systems
Abstract
A statistical function is a function that process a data set containing many sample points, computing a "statistic" that summarizes the data. Simple examples are Mean and Variance, but more complex examples may return matrices or tables. In this talk, I'll review statistical functions that are built into Analytica 4.0. In Analytica 4.0, all built-in statistical functions can now be applied to historical data sets over an arbitrary index, as well as to uncertain samples (the Run index), eliminating the need for separate function libraries. I will demonstrate this use, as well as several new statistical functions, e.g., Pdf, Cdf, Covariance. I will explain how the domain attribute should be utilized to indicate that numeric-valued data is discrete (such as integer counts, for example), and how various statistical functions (e.g., Frequency, GetFract, Pdf, Cdf, etc) make use of this information. In the process, I'll demonstrate numerous examples using these functions, such things as inferring sample covariance or correlation matricies from data, quickly histogramming arbitrary data and using the coordinate index setting to plot it, or using a weighted Frequency for rapid aggregation.
In addition, all statistical functions in Analytica 4.0 can compute weighted statistics, where each point is assigned a different weight. I'll cover the basics of sample weighting, and demonstrate some simple examples of using this for computing a Bayesian posterior and for importance sampling from an extreme distribution.
The Analytica model file that had resulted by the end of the presentation can be downloaded here: User Group Webinar - Statistical Functions.ANA.
Manipulating Indexes and Arrays in Analytica Expressions
Date and Time: Thursday, Aug 9, 2007 at 10:00 - 11:00am Pacific Daylight Time
Presenter: Lonnie Chrisman, Lumina Decision Systems
Abstract
In this webinar, I will review many of the common operations applied to indexes and arrays from within Analytica expressions, with a particular emphasis on enhancements in this area that are new to Analytica 4.0. I'll review the often used and very powerful Subscript and Slice operations, along with the duality of associational and positional indexing. I'll introduce newly introduced extensions for positional indexes, such as the @I, A[@I=n], and @[I=n] operations, and extensions that expose positional duals to various previously-existing associational array functions. I will describe the distinction between index and value contexts in Analytica expressions, along with the distinction between a variable's index value, mid value and sample value, how these may differ (Self-Indexed Arrays), and how we may access each context-value explicitly. I will also introduce slice assignment -- the ability to assign values to individual slices of an array within an algorithm.
The content of this webinar is most appropriate for users with moderate to advanced Analyica model-building experience.
Here is the Analytica model that was created during this talk: "Indexes and Arrays UG2.ANA". (This wouldn't be very interesting for someone who didn't attend, but it contains the examples we tried).
Edit Table Enhancements in Analytica 4.0
Date and Time: Thursday, Aug 2, 2007 at 10:00 - 11:00am Pacific Daylight Time
Presenter: Lonnie Chrisman, Lumina Decision Systems
Abstract
In this webinar, I will demonstrate several new edit table functionalities in Analytica 4.0, including:
- Insert Choice drop-down controls in table cells.
- Splicing tables based on computed indexes.
- Customizing the default cell value(s).
- Blank cells to catch entries that need to be filled in.
- SubTables
- Using different number formats for each column.
This talk is oriented for model builders with Analytica model-building experience.
The Analytica session that existed by the end of the talk is stored in the following model file: "Edit Table Features.ana".
Potential future topics
If you would like to see a webinar on a given topic, please feel free to add it here. If you see a topic listed and would like to be a presenter, let us know.
- Rapid review of features new to Analytica 4.0.
- Importance Sampling. Global sample weighting and use of extended statistic functions in 4.0.
- Topics in Regression: Using the Regression function in flexible ways, such as infering VARMA models, DFTs, etc. Estimating secondary statistics (i.e., uncertainty in the parameters) and modeling the full uncertainty in resulting model predictions (the RegressionDist function, etc). Alternative regression models (Probit_Regression, Logistic_Regression, Possion_Regression, etc).
- Logistic Regression: Quick intro to logistic regression (generalized regression), including Probit_Regression, Logistic_Regression, Possion_Regression, etc. Using these to fit probability estimates in Analyica, Analyica Optimizer experience, exploring result with new graphing features.
- New 4.0 graphing features general overview
- Creating graphs of multi-dimensional data.
- Graph Style Templates: Creating libraries of style templates, including some behind-the-scenes settings.
- An in-depth look at graph style settings.
- MdxQuery - Interacting with Microsoft Analysis Services or other OLAP servers.
- Producing graphs from ADE: Including how to serve graphs from web pages.
- Manipulating dates in Analytica
- Integrating with external programs: Utilizing external programs or scripts (VBScript, Perl, etc) from within an Analytica model.
- An introduction to button scripting in Analytica
- New extensions to the Analytica Optimizer
- Introduction to Linear, Quadratic and Non-Linear Programming, and the basics of using Analytica Optimizer.
- Intracacies of the Domain attribute
- Writing user-defined functions. Understanding parameter qualifiers. Introduction to new 4.0 qualifiers. Writing distribution functions. Writing array abstractable functions.
- Mastering Array Abstraction
- Sampling and Distributions - new 4.0 additions/extensions. Also, writing custom User-Defined Distribution Functions.
- Integrating with external applications using RunConsoleProcess.
- Handles and Meta-Inference.
- Using references (the \ and # operators)
- Getting data into Analytica.
- Implementing iterative algorithms. Convergence algorithms using Iterate. Use of While..Do. Recursive functions, slice assignment, etc.
- Large-scale sampling. Techniques when memory limitations constrain sampleSize.
- Creating User-Defined functions. Review of Function Parameter Qualifiers.
- Understanding Evaluation Contexts
- Bayesian Inference
- Sensitivity Analysis.
- Dynamic Programming
- Correlated and multi-dimensional distributions
User Survey Results
During the first week of September, we sent out a survey to people who had attended webinars so far. Please continue providing us with feedback. Here is some feedback to date:
Level of difficult and speed:
So far, of those who answered this question, 25% say "a bit too easy", 25% say "too hard/fast", and 50% say "just right".
Topics requested for future webinars:
- How to run multiple iterations, e.g. 100 iterations with uncertainty sample of 1000.
- Sampling for rare events.
- Using the lognormal function.
- Financial modeling
- New array functionality (subtables, choices in tables)
- Optimizer !!!
- Dynamic models (twice requested)
- Choice of distributions
- Re-sampling and radomize methods and uncertainty sample size
- Tricks for sensitivity analysis
- Input and output nodes
- Importance analysis
The Analytica Wiki
The Analytica Wiki contains many resources, including in-depth reference materials, relevant articles, example models, tutorials, etc., to help users master Analytica and find what they need. Even better, Analytica users can contribute! You can upload your own models, articles, expand on or correct materials that are there, etc., for the benefit of the entire Analytica community.
The Analytica Forum
The Analytica Forum is a message board where users can post questions to the Analytica community, or view what others have posted. Many materials of general interest have been posted there (however, we hope to eventually update the Wiki to reflect all this material, where it can be more conveniently organized). The forum is maintained indepedently by an enthusiastic Analytica user. Our thanks to to Mike for all his efforts!
Enable comment auto-refresher