Latest videos and articles about RTC SCM

For some of us working in RTC SCM, it's a big snow day, we're not just dreaming about a white Xmas :-) For our developers in locations where snow is a rarity, you cannot imaging the joy of clearing up your drive way... This said, time to reflect on what we've done and published for our RTC users.

Since the articles and videos we listed last July and August, much more has happened in the last  five months.

For CLI users, check out these three videos from Shashik and Sridevi.

• Enhancements to the command line 'diff' command  in Rational Team Concert 4.0.1
• Getting/setting properties of SCM artifacts using Rational Team Concert SCM CLI
• Managing the flow targets of a workspace or a stream using Rational Team Concert SCM CLI

If your source code base is large - or should I say, huge - and you have to deal with many variants, you want to carefully think about how to organize it in your SCM. Here are tips illustrated with the popular Android OS code base, from John.

• Managing variants of the source code for Android OS using Rational Team Concert

How you use your source with your local tools and how you version it in RTC can be straightforward or very sophisticated. These two articles go to great depth in load workflows.

• Loading Content from a Jazz Source Control Repository in Rational Team Concert 4.0
• Loading with Load Rules in Rational Team Concert 4.0 and later

Yes, process is built-in with every component of RTC - Work Item, planning, build and of course source control. If you're a scrum master, component lead or project manager, this article from Evan is a must read.

• Source control process recipes for Rational Team Concert

And if you want to upgrade to the latest version of your VS IDE, we got it covered... Vandana gives an overview there.

• Rational Team Concert introduces support for Microsoft Visual Studio 2012

For tips on how we review changes when fixing defects and how we set process conditions to ensure appropriate reviews are in place, have a peek at this blog post from myself, and its two videos.

• Reviewing code changes with Rational Team Concert

See you in 2013! We've got more in the pipeline...

Try out the latest 4.0.1 RTC SCM in the jazz.net sandbox

It's really easy to get a feel for the latest RTC SCM 4.0.1. The jazz.net sandbox gets you up and running in seconds. All you need is a jazz.net login account. You'll have your own project area hosted on jazz.net, ready for your trial of RTC and SCM.

Create your jazz.net sandbox

1. Go to www.jazz.net/sandbox . You may have to create a free jazz.net user account if you've never been there before. That will also allow you to open work items and ask questions on the forum.
2. Pick the option /sandbox2 - you'll get your project hosted on the very latest RTC 4.0.1 server
3. Give a name to your project area - e.g. mine is called chrisx's 4.0.1 project.

Upload content into your jazz.net sandbox

Click on Source Control / Welcome to Source Control. You're ready to try our latest SCM!

Your project area is mostly empty to start with. It does come with a default stream, into which you can add folders and files. From the Welcome to Source Control page, click on Show Streams and navigate into the one stream listed there. It has one component which contains no files or folders. Adding new files and folders is very easily done through the Web UI. Click on the Add folder icon as indicated below, give it a name and hit save.

Once that folder is created, you can upload new files, etc. Here below we created a new text file named 'readme.txt'.

Invite others to your sandbox on jazz.net

Being alone isn't the greatest way to try a collaborative tool. So go back to www.jazz.net/sandbox, click on sandbox02/ again. This lists all your project areas, including the one you have just created. Click on the Invitations button and bring your teammates to your trial party. Once they accept your invitation, they will be added to your project area. They will be able to see the files you have added earlier to that default stream and start collaborating with you through RTC Source Control.

Try out the other (non Web UI) RTC Source Control clients

At that point you and your co-workers may want to try out other RTC clients such as the Eclipse RTC Client, RTC Client for Microsoft Visual Studio, RTC Shell (which integrates into the Windows Explorer) or the Command Line Interface tool. You can download the desired client (and your own server if you want to go beyond what the jazz.net hosted sandbox provides) at https://jazz.net/downloads/rational-team-concert/.

As an example, I downloaded and installed the RTC Shell client. This client integrates into the Microsoft Windows Explorer, so I can easily sync up files and folders loaded on my local drive and collaborate with my team members. After the installation, you just accept the team invitation (see below) which is available from the jazz.net sandbox (see above).

I followed the recommendations of the 'Accept Team Invitation' wizard. I created a repository workspace from the stream I had been using earlier and loaded its content under my local drive. It created the expected Documents folder and readme.txt file I had added through the Web UI.

This is showing the RTC Shell client integrated into Windows Explorer. This content was loaded from the RTC server hosted on the jazz.net sandbox. I can make changes to these files and folders with my local editors (Notepad etc.), check-in and deliver them so that others in my team can access them.

Summary

It's really easy to get a quick feel for our latest RTC SCM, with the jazz.net sandbox. And if all you want is to play with our Web UI, you have nothing to download!

Icons used in Rational Team Concert Source Control

The Eclipse client for RTC, RTC Client for Microsoft Visual Studio and the Web UI use specific icons to represent SCM artifacts. These base icons are enhanced with extra visuals relative to their status in certain views (e.g. the Team Artifacts view, Pending Changes view, Repository workspace editor, etc.). Here's a list of the basic icons and their variants used in the SCM. If you are not familiar with any of the terms used below, please try out Good practices and key workflows for Rational Team Concert Source Control users for appropriate references.

Stream

 Repository Workspace

Snapshot

 Baseline

Component

1. Component (if shown within a repository workspace, also indicate it is loaded or partially loaded in my sandbox)
2. Component owned by a project area
3. Component owned by me
4. Component owned by a contributor who isn't me
5. Component (if shown within a repository workspace, also indicate it is not loaded in my sandbox)

 

Change Set

1. Change set (active i.e. not completed, not linked to any work item)
2. Current change set (active i.e. not completed, auto check-in will default to this change set)
3. Completed change set (not linked to any work item)
4. Completed change set linked to one work item
5. Completed change set linked to two or more work items

If you are puzzled by other SCM icons, please drop a comment below with a link to a screen capture (e.g. attach it to the work item 40464). Hope this reference will be helpful to you.

Note. For icons inside the Pending Changes view, explanations are also provided here.

working with different currencies

One of the things that I like the most about Rational Team Concert is how we solve problems which cross-cut across the developer's perspective.  What this means is that the change sets that a developer produces are linked to work items, which often have a particular process workflow to them.  The change sets are also captured in snapshots via builds, so we have traceability from builds right through to the work item or plan.  We almost take this traceability for granted, having used the product now for > 5 years and counting.  This traceability provides another benefit that may be subtle to some people.

The linking of work items to change sets allows for users of different backgrounds to talk about the same problem in language that they are most familiar with.  We have found that many people indicate that they "deliver work items" to the stream when they are done.   The work item tends to be where the discussion happens, and where consensus is reached.  The code artifacts are derived from that understanding.  So when talking to a development manager, they are interested in knowing that the work item is closed (and the fix delivered) rather than the specifics as to how the fix was done.

So while developers may talk change sets, their bosses may talk work items, or change requests.  Which is why we try and write features which deal in both currencies, like Locate Change Set.

As you see in the above screenshot, Locate Change Set allows users to work with either change sets or work items in order to ensure that people can answer questions using the terms and currencies they are most comfortable with.

Similarly, when someone compares builds, the comparisons come back in the forms of change sets or work items.  We have numerous features in Rational Team Concert that work like this.  When you allow for users to answer questions using the concepts they are most comfortable with, you create an ease of use that really helps to allow different roles to enjoy using the product.  

Preview - Gap detection when reviewing changes (Eclipse & VS clients)

A developer gets often asked to review the changes associated to a work item. What if some change sets are missing? The new Change Summary view detects inconsistent situations automatically for you.

In the above example, the reviewer selected the change sets associated to the work item to be reviewed and clicked 'open'. The Change Summary view shows which files are modified by these change sets. The file MobileWebView.java is flagged with a special decoration - a red square and a description 'in 2 disjoint change sets'. What is so special about this file?

The reviewer decides to double-click on this element. Instead of a compare editor showing the changes to that file, a prompt comes up.

 

The file MobileWebView.java is modified by 2 disjoint change sets, i.e. change sets that aren't related to each other because they refer to unrelated versions of MobileWebView.java. The Details pane comes up automatically in this case, showing the change sets that have a gap as shown below. The dependency graph is actually disconnected (broken green and red graphs).

The reviewer can ping the developer on the work item and ask him or her if they have forgotten to associate a change set to the work item. In this case, the developer had associated a change set to a different work item by mistake. After moving it to the correct work item, the reviewer could review the three change sets together correctly.

Note. In certain situations, disjoint change sets are expected and perfectly valid (e.g. developer had to do multiple change sets intertwined with deliveries from other team members). The reviewer will simply review each disjoint change set through the Details pane.

Note. Prior to 4.0.1, there was no Details pane. Disjoint changes were represented as multiple nodes in the Change Explorer view with no identifier about which change set they originate from. In 4.0.1, the Change Summary pane and the Details pane provide more comprehensive information in these situations, making code review both efficient and safe.

Note. Visual Studio client figures the same details pane support in the Change Summary view, as illustrated below. This feature was jointly developed in 4.0.1 by a feature team working simultaneously on the Eclipse, Visual Studio and Server development. In prior releases, different component teams were responsible for adopting new features, usually in different milestones.

Note. Expect to be able to try out this new feature with 4.0.1 M4. As we are transitioning toward feature teams and continuous delivery, I am experimenting with previewing our latest work on this non official blog. Go to jazz.net for the latest milestone build and official new and noteworthy. There is no guarantee a preview will make it to a stable build.

Preview - New details pane when reviewing changes (Eclipse & VS clients)

In certain situations, seeing all the combined changes from the various change sets doesn't give a clear picture. The reviewer may want to understand which individual change sets modified the file MobileWebView.java. Simply turn on the 'Show details pane' option under the Change Summary's drop down menu. This brings up the Details pane shown below.

 In our example, the file MobileView.java was modified by all three change sets created by Christophe. Each change set's comment is available, which can help understand the purpose of each change set. Dependency graph shows the ordering of the change sets and the reviewer can double click on each row to inspect each change individually, gaining a progressive idea of how the whole bug was fixed.

Note. Expect to be able to try out this new feature with 4.0.1 M4. As we are transitioning toward feature teams and continuous delivery, I am experimenting with previewing our latest work on this non official blog. Go to jazz.net for the latest milestone build and official new and noteworthy. There is no guarantee a preview will make it to a stable build.

Preview - New dedicated Change Summary view for reviewing change sets (Eclipse & VS clients)

Once a bug is fixed, a good practice is to ask one of your peers to review your changes. Ping them on the work item you have resolved or set an approval. The reviewer will be notified and will open the associated change sets.

 

The reviewer can then go through every file that was modified and open a compare editor showing the combined changes for that file.

 

In the above example, the reviewer selected the file MobileWebView.java and double clicked (or right clicked and selected the action 'Open in Compare Editor'). This brings up a compare editor that shows how the selected change sets combine to modify that file.

Note. The Change Summary view should look familiar since it is drawn from the previous Change Explorer in the 'Show Files' mode. The previous Change Explorer view supported two modes, one focused on file changes 'Show files' mode and one focused on comparing sources such as streams and workspaces 'Show change sets' mode. In 4.0.1, the 'Show files' mode is evolving with richer capabilities such as the Details pane and is moved to a separate new view named 'Change Summary'.

Workflow	View used in 4.0.1	View used in previous releases <= v4.0	Artifacts shown
Review change sets	Change Summary	Change Explorer in 'Show files' mode	files and folders affected by selected change sets
Compare workspaces, streams, snapshots or baselines	Change Explorer	Change Explorer in 'Show change sets' mode	Change sets (e.g. change sets from source stream that aren't in target stream and vice versa)

Note. Expect to be able to try out this new feature with 4.0.1 M4. As we are transitioning toward feature teams and continuous delivery, I am experimenting with previewing our latest work on this non official blog. Go to jazz.net for the latest milestone build and official new and noteworthy. There is no guarantee a preview will make it to a stable build.

Preview - Choose which change sets to review or accept from a work item (VS Client)

The Work Item editor in the Visual Studio client now lets you select the associated change sets you want to open or accept (Press CTRL key and mouse click over the selected change set triangle icon and repeat as desired).

Note. Expect to be able to try out this new feature with 4.0.1 M4. As we are transitioning toward feature teams and continuous delivery, I am experimenting with previewing our latest work on this non official blog. Go to jazz.net for the latest milestone build and official new and noteworthy. There is no guarantee a preview will make it to a stable build.

Change set under the microscope

RTC Source Control users deal with hundreds or thousands of change sets every day. Let's stop a bit here and have a look at what a change set looks like under a microscope.

Change sets are everywhere. Wherever you put your microscope inside SCM, you'll quickly find them under the cover.

• In the Work Item editor, as links to the code that was modified to fix that work item.
• In the Pending Changes view, as the currency you exchange with your team to collaborate
• In the History view of your workspace or of your team stream, nicely sequentially organized
• In the Build Results page, showing you what happened to the code since the previous build
• In a Source Editor, when using the annotate feature

Under the naked eye, this is how a change set looks like, an innocent blue triangle:

When you create a change set, it remembers you for ever. So anyone who finds this change set will know its author. It also knows the date and time related to its creation.

A change set describes its purpose with a comment. It describes its mission with a bi-directional link to a work item. So you can trace back why that change set is there and who approved it, give feedback.

A change set is tied to a component. If you have permission to see the component, you can see the change set. Otherwise you won't. A change set is designed to flow between workspaces and streams, within the same RTC server or between different RTC servers.

A change set knows who it is. It is different from all the other change sets out there in the world. It's important because that is how RTC Source Control is a modern distributed SCM. A change set has a unique ID. We'll never mix your change set with mine, even if we are on different servers.

Now it's time to zoom into the core of a change set. Until now, we were just looking at its outer shell... A change set holds an immutable list of files and folders, with their expected starting state (required to apply the change set) and final state (after the change set is applied). It's immutable once its author decided to seal it (by completing or delivering it). The change set will forever describe how to take a set of resources from a particular state to another particular state.

There are things you won't see in the change set itself. Content of the files changed in the change set isn't part of it. You see, the change set is designed to be a very lean entity so you can scale huge histories of change sets and not hurt the database. Change set only contains the IDs that identify the starting states and final states of the files and folders modified. The content corresponding to these states is efficiently stored once in the DB (keyed with a hash). A change set is a bunch of ID's, not a huge text patch.

Another thing you won't see is path names. The change set stores the name of the files and folders that are modified (or moved, renamed..). But being efficient and portable, it stores only the ID of the parent folder of these modified items. No lengthy path name. Change set describes a change in a mathematically accurate manner (IDs). Of course humans will need to see path strings at some point e.g. src/com/my/project/A.txt. The UI resolves these paths when needed in the context (configuration) in which the change set is used (your workspace, a stream, etc.). For most SCM operations, only IDs matter. IDs are reliable and efficient (and unique). Paths are only useful when a reviewer is looking at the change set.

Sometimes a bacteria runs into another bacteria and consumes it. Some change sets are the result of merging change sets. For each file or folder merged, the change set tracks the starting state, the merge state(s) and the final (merged) state. So a change set knows it represents a merge between conflicting states and the UI can specially decorate it to get user's special attention (hey, did my team mate override my change?).

And this allows SCM to show the following merge graph. It displays the relationship of the states in the change sets forming the history of a file in a particular stream or workspace.

At that point, we've used a regular magnification. But we can push further, though beware most users usually don't get in there. A change set also knows a lot about how its author got to that final state for each file or folder it modifies. In the early stages of a change set, its author checks-in local changes he or she made to files and folders. The same file may be modified and checked-in many times into that same change set. The last check-in will define the final version - the one that will be applied with the change set. But the change set also remembers somewhere very deep each intermediate version that was checked-in before it was sealed. Since 4.0, these versions are available to the user through the File History View / Check-in History pane.

That's how far we will take our journey inside a change set today. It's the building block of SCM, and a pretty solid one.

Back to school with RTC Source Control 4.0 videos

It's almost september. Quickly catch up on some of the latest SCM features we added in version 4.0 (also known as CLM 2012)...

Note these videos support HD (high definition), they are best enjoyed full screen and with the youtube player's video quality changed to 720 (HD).

1. RTC Shell - easily share documents and collaborate with your RTC team from within the familiar Windows Explorer. There are certainly members in your team who will appreciate using a lightweight client instead of a full IDE.



2. Locate change sets - When work items and source control play together, it becomes so easy to figure out which bugs you need to backport. Beware, that feature will greatly simplify your life when dealing with multiple streams. It plays the natural strength of RTC - team artifacts are connected and integrated with each other. That's a feature the SCM dev team uses very frequently itself.




3. Item read permissions - Control who can access specific files and folders within a component. Perfect if you work with third parties and consultants who need deep yet controlled access to your data.




4. File Content Delete - RTC administrators, learn how you can permanently purge unwanted content from an RTC server. Physically remove the bytes of an unwanted document, from wherever it is referenced in the database.



If you know about other videos related to new SCM 4.0 features, please add a comment and a link below. Thanks!

hacking the jazz.net website using the scm command line

Recently, I switched to running Linux on my laptop.   With this change, I am provided with an opportunity to change the way that I work with RTC.  For the past year, I have been self hosting on the RTC Windows Shell Integration whenever I have needed to deal with documents or files that are not better housed in an IDE (like Eclipse).  But there is no Lightweight RTC Shell on Linux (and one is not yet currently planned).

I am always looking for opportunities to self host more on the RTC SCM command line tool[1].  It has come a fair way over the past couple of years, but since we do Eclipse development so much, it is too easy to fallback on the eclipse client.  I don't really hack much code these days, and I do spend more time writing documents, articles and presentations, so using the CLI to further these endeavours is the way to go.

Setting up my new sandbox for jazz.net tonight, I discovered that there are things that I can do better in the command line.

For example, for a truly large component, like the Jazz.net website, I can programmatically list remote files and grep in order to find exactly the directory I want to load.

lscm ls rf -r repoNickName 1109 1111 /my/directory --depth - | grep uniqueFolderName

where 1109 is a CLI alias for the workspace I am using, and 1111 is the alias for the component.  These aliases are discovered through other queries like "ls comp" or "ls ws" which serve as ways to query and find artifacts in the repository to work against.

Then the load command looks like:

lscm load 1109 MyComponent/my/directory/some/other/path/uniqueFolderName

You can do the same thing when loading in Eclipse, but people often do not choose to navigate through the wizard.  I find that you think differently when using console tools than you do when you use graphical user interfaces.

For one thing, with a command line tool, the onus is on the developer to find ways to optimize their environment more.   Using aliases and writing scripts are two examples of how you can easily customize the way you interact with the system.

Additionally, command line users actually read the help.  All it takes is one type-oh, and as a command line user, you are reading help, or in the very least skimming it.  I can't remember the last time I used help in an Eclipse-based product.

I hope that if you want to try something different when you are working against a filebase which does not endorse a particular IDE or toolchain you will consider the SCM Command Line.  We have numerous articles[2] which are helpful for getting started.

[1] Today I raised this bug on the help : self hosting in action!

[2] Here are some articles.

• https://jazz.net/library/article/620
• https://jazz.net/library/article/192#CLI
• https://jazz.net/library/article/195/

Spice up your pending changes view

When you're in a hurry, fast food is convenient. But after a while, you're going to get tired of the limited choice between ketchup and mayo for the dressing. Same thing goes with RTC Source Control. By default, it comes with certain preferences that work well in common situations and will get you started quickly. But once you use the tool extensively, it's time to explore some of the ways you can customize its UI to fit your taste. Here we will focus on the Pending Changes view. We will assume you are familiar with that view and its typical workflows (check-in, accept, deliver...). The view offers you plenty of flavors to choose from...

Auto check-in or not auto check-in?

 

By default, you have to manually check-in your local changes. Edit a file, save it. A local change shows up in the Pending Changes view. Select it and check it in. That's probably the way you've been working from day 1. There's an alternative way that works really well for certain users. Go to Eclipse > Window > Preferences > Team > Jazz Source Control > Changes > Check-in Policies. Check the Auto check-in local changes option and don't worry about the other options on that page. That's it, you're set. As long as you are logged in, every time you edit and save a local file, the new version gets automatically checked-in. Convenient. Try it and see if you like it. In our experience, some people prefer to drive manual, this is up to you...

Verbose or not verbose?

 

To help you decide if you are ready to accept or deliver a change set, Pending Changes view shows you various properties related to that change set - the person who created that change set, when it was delivered, files that were added, deleted, renamed, etc. Some users love details. Others prefer a view with no clutter. Turn on or turn off what you want in Eclipse > Window > Preferences > Team > Jazz Source Control > Changes > Label Decorations.

Eclipse compare editor or third party compare editor?

 

Before accepting or delivering changes, you double click and inspect them in a compare editor. By default, we use the built-in Eclipse compare editor. But there are other options out there in the market, and we know some are very popular. So we make it easy for you to plug in your own compare editor. Use Eclipse > Window > Preferences > Team > Jazz Source Control >  External Compare Tools.

The tool comes with predefined settings for some popular third party compare editors. If yours isn't listed, you can manually specify the arguments it requires from Source Control.

These are in my opinion some of the most useful ways you can tweak your Pending Changes view. If you're a big fan of some other options not listed here, please add a comment and explain how it makes your life easier...

SCM Reader's digest for the summer

What are you doing this summer? Going to the beach, training seals at a water park or working at the local cube farm?

Either way, there could not be a better time to grab our new articles freshly posted on jazz.net. You'll learn about the new advanced workflows we've added to Rational Team Concert Source Control in our latest 4.0 release.


 
 Here's the list...

• File Storage and Content Compression in Jazz SCM - for admins and developers who want to know how their Source Control stores their precious data

• Deleting Content From Source Control in Rational Team Concert - for admins who need to permanently remove content that should have never been stored
• Read protect some files or folders within a component - for project managers who live in a world where certain things are for your eyes only. Because even in the Internet age, privacy does matter to organizations working with various third parties.
• Using the Jazz SCM command line to support software configuration audit - for admins performing a system level audit, this article describes how to produce a Bill of Materials.
• Using Rational Team Concert on Mac with XCode (Part 1) -  for developers who are looking to share their XCode projects into an RTC server

If you're coming from an older version, you can browse through the 4.0 improvements to Source Control under the new and noteworthy. If you like some of these 4.0 features, please drop us a note on the forum or on this blog, tell us how it makes your life easier... And if I missed a new article about 4.0, let me know!